-- Logs begin at Fri 2021-08-27 02:49:42 UTC, end at Fri 2021-08-27 03:56:01 UTC. -- Aug 27 03:16:19.738500 dv-cinder-804735-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 27 03:16:19.749680 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 03:16:19 2021] *** Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: nodename: dv-cinder-804735-2-iscsi Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: machine: x86_64 Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: clock source: unix Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: pcre jit disabled Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: detected number of CPU cores: 4 Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: current working directory: / Aug 27 03:16:19.751840 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:16:19.752377 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: your processes number limit is 47680 Aug 27 03:16:19.752377 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: your memory page size is 4096 bytes Aug 27 03:16:19.752377 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: detected max file descriptor number: 2048 Aug 27 03:16:19.752377 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: lock engine: pthread robust mutexes Aug 27 03:16:19.752377 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: thunder lock: enabled Aug 27 03:16:19.752377 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 27 03:16:19.752377 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 03:16:19.796721 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: Python main interpreter initialized at 0x55c7e07a69c0 Aug 27 03:16:19.796721 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: python threads support enabled Aug 27 03:16:19.796721 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: your server socket listen backlog is limited to 100 connections Aug 27 03:16:19.796721 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:16:19.797112 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:16:19.797112 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: *** Operational MODE: preforking *** Aug 27 03:16:19.797432 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:16:19.797432 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: spawned uWSGI master process (pid: 73378) Aug 27 03:16:19.797609 dv-cinder-804735-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 27 03:16:19.798185 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: spawned uWSGI worker 1 (pid: 73389, cores: 1) Aug 27 03:16:19.798512 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: spawned uWSGI worker 2 (pid: 73390, cores: 1) Aug 27 03:16:19.798734 dv-cinder-804735-2-iscsi devstack@keystone.service[73378]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:16:24.853611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:16:24.853611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: from cryptography.utils import int_from_bytes Aug 27 03:16:24.854474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:16:24.854474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: from cryptography.utils import int_from_bytes Aug 27 03:16:24.863577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:16:24.863577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: from cryptography.utils import int_from_bytes Aug 27 03:16:24.864093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:16:24.864093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: from cryptography.utils import int_from_bytes Aug 27 03:16:24.903570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:16:24.903760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:16:24.903894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] command line args: [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:16:24.904195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:16:24.904325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ================================================================================ {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:16:24.904608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] admin_token = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.904852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] config_dir = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.905012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.905223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] config_source = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.905365 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] debug = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.905566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] list_limit = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] log_config_append = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] log_dir = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] log_file = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.907902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.908212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.908393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.908656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.908786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.908972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.909240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.909452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.909712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.909915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.910168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.910378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.910471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:16:24.910618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.910761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:16:24.910845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] command line args: [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:16:24.910922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.911109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:16:24.911199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.911373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ================================================================================ {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:16:24.911555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] admin_token = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.911642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.911786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] publish_errors = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.911878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] config_dir = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.911950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] config_source = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] debug = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.912979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] standard_threads = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] list_limit = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] log_config_append = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] use_journal = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.913896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] use_json = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] log_dir = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] use_stderr = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] log_file = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] use_syslog = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.914783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.914942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.915028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.915183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.915297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.915399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.915472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.915547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.915697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.915770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.915943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.916090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.916173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.916245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.916407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.916501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.916649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.916737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.916892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.916979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.917134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.917222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.917363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.917443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.917604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.917692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.917838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.918078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.918159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.918312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] publish_errors = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.918392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.918542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.918629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.918765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.918853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.918924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.918999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.919175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.919263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.919435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.919517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.919670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] standard_threads = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.919753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.919910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.919985 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.920136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.920224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.920296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.920422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.920512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] use_journal = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.920618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] use_json = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.920700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.920791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] use_stderr = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.920873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.920951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] use_syslog = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.921067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.921182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:16:24.921313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.921436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.921558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.921675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.921784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.921933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.922984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.923141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.923219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.923390 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.923470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.923708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.923832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.923995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.924981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.925977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.926918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927564 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.927876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.928967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.929909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.930873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.931996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.932079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.932230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.932355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.932462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.932560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.932996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.933969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.934974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.935923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.936885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] auth.external = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.937984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] auth.password = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] auth.token = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.938994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.939176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.939266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.939499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.939770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.939930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] credential.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.940968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.941993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.942998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.943167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.943243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.943449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.943542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.943692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.943801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.943923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] auth.external = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] auth.password = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.944964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] auth.token = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.945916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.946997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] credential.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.947973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.948927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.949917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.950895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.951888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.952974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.953936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.954947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.955095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.955173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.955327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.955499 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.955714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.955823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.955950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.956978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.957924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.958887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959163 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.959846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.960951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.961960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962343 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.962891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963625 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.963860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.964958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965515 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.965980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.966917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.967891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968360 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968751 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.968979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.969933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] role.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970741 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] role.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.970996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.971063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.971246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.971326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.971517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.971624 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.971764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.971862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972111 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.972994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.973962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.974901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.975908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.976858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] role.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] role.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.977945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.978968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.979999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.980949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.981981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.982919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.connection = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.983916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.984865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985089 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.985942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986758 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.986992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.987959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.988040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.988112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:16:24.988268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.988505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.988756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.988991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.989242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.989489 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.989723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.989963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.990230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.990488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.connection = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.990729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.990975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.991213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.991488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.991722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.991963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.992197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.992432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.992674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.992940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.993183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.993417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.993663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.993897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.994139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.994371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.994610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.994845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:16:24.995013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:16:25.018852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.019048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.019292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.021058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.021271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.021530 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.027999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.030120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.056418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.056606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.056832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.057023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.112456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.113077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.167812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.168081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.233212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.233422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.239236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.239469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.239724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.239917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.240167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.240356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.278156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.278382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.278582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.278798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.279030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.279207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.302474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.302712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.302914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.303152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.303333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.303607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.303797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.316523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.329784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.330071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.330238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.330478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.330672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.330910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.331121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.341293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.341531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.341760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.341956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.342205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.342392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.342633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.348530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.348745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:16:25.349083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.349355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:16:25.349545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.349799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.350054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.350314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.350492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.353602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.353842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.354029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.354281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.354473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.354714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.354890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 03:16:25.360836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.361204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.361412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.361685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.365419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.365595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:16:25.365901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.366170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 03:16:25.366562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.366826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.367093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.367376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.370233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.373469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.373744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.374020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.374292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.374568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.374826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.375093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.375332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.375649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.375918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.376183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.378617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.378898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.379179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.379494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.387697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.390951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.391230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.391548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.391835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.392132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.392429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.392694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.393156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.393458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.393741 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.394007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.402798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.404418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.404695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.410028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.410426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.410707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.417879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.418161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.420570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.422156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.422437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.422560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.422830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.423107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.423371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.424109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.424109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.424344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.424568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.428358 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.428639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.429033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.436600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.436886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.441698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.441990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.442287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.442569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.442840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.443125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.443251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.443412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.443533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.443698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.448070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.451676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.452074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.457611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.461197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.462441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.462724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.464810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.465106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.465390 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.465671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.465957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.466236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.467219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.470896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.471209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.476384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.479965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.483574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.483873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.484155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.484448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.484735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.485016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.485629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.485916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.486346 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.486616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.494381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.496127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.496405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.499563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.499852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.500135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.500414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.500689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.504433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.504705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.504974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.505239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.512984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.514473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.514674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.514769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.514902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.514985 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.515279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.515673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.515952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.516238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.518277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.518581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.518883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.519150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.519472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.533392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.533720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.533887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.534002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.534315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.536067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.536359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.536645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.537153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.540433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.543338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.544980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.545255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.545535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.552953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.554515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.554659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.557995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.558147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.558259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.558690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.558995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.561353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.563070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.564810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.565132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.565427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.568112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.568398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.568676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.572608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.574190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.576397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.576670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.576943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.577214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.577337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.577509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.577650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.577844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.578024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.578151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.578287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.578370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.578675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.578946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.579233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.579519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.579926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.580204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.588487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.588788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.589080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.597104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 03:16:25.597385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.597664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.597949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.598235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.598607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.598882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.599156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.599421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.599730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.600021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.600292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.600550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.600815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 03:16:25.617769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7e07a69c0 pid: 73390 (default app) Aug 27 03:16:25.621140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dde1-d19f-4e9a-9b6b-e6d0f06ed735 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:25.621433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dde1-d19f-4e9a-9b6b-e6d0f06ed735 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:25.621710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dde1-d19f-4e9a-9b6b-e6d0f06ed735 None None] PATH_INFO: `/v3` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:25.625960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 792 bytes} [Fri Aug 27 03:16:25 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:25.638617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7e07a69c0 pid: 73389 (default app) Aug 27 03:16:33.288713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973a68-eabf-4cd8-863d-fcbda7c0fd37 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:33.289295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973a68-eabf-4cd8-863d-fcbda7c0fd37 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:33.289295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd973a68-eabf-4cd8-863d-fcbda7c0fd37 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:33.291324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:16:33.301919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:33.302335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:33.302534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:33.349610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:16:33.556825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG passlib.handlers.bcrypt [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73389) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 03:16:33.557271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG passlib.handlers.bcrypt [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73389) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 03:16:33.614879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:33.616550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:33.768637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1/3] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:33.939723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd973a68-eabf-4cd8-863d-fcbda7c0fd37 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:33.980508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG oslo_db.sqlalchemy.engines [None req-dd973a68-eabf-4cd8-863d-fcbda7c0fd37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:16:34.120263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd973a68-eabf-4cd8-863d-fcbda7c0fd37 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:34.125846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514fc0d-be74-458b-99f0-fadc297edb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:34.126506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514fc0d-be74-458b-99f0-fadc297edb10 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:34.126973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514fc0d-be74-458b-99f0-fadc297edb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:34.127443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514fc0d-be74-458b-99f0-fadc297edb10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:34.135935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514fc0d-be74-458b-99f0-fadc297edb10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:34.186985 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7514fc0d-be74-458b-99f0-fadc297edb10 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 03:16:34.187331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514fc0d-be74-458b-99f0-fadc297edb10 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:34.198138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 3/4] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:34.208170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:34.231969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3cb7c-7685-48f1-93ad-812867ad3849 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:34.239379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d3340-04a8-4d61-a91b-fbc8eb8dcb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:34.240470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d3340-04a8-4d61-a91b-fbc8eb8dcb33 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:34.240845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d3340-04a8-4d61-a91b-fbc8eb8dcb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:34.241123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d3340-04a8-4d61-a91b-fbc8eb8dcb33 admin admin] PATH_INFO: `/v3/projects/dd18f6074b9647bca69baffc389eb123` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:34.242870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d3340-04a8-4d61-a91b-fbc8eb8dcb33 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd18f6074b9647bca69baffc389eb123)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:34.294345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.common.rbac_enforcer.enforcer [None req-386d3340-04a8-4d61-a91b-fbc8eb8dcb33 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 03:16:34.294679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d3340-04a8-4d61-a91b-fbc8eb8dcb33 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:34.299335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 2/5] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:34 2021] GET /identity/v3/projects/dd18f6074b9647bca69baffc389eb123 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:36.483837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bda21-4def-455d-91fa-cf2fb703964c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:36.484429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bda21-4def-455d-91fa-cf2fb703964c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:36.484429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bda21-4def-455d-91fa-cf2fb703964c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:36.489083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 4/6] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:36 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:16:36.496590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821280-b364-4497-a159-ff82e03811c7 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:36.497346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821280-b364-4497-a159-ff82e03811c7 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:36.497489 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8821280-b364-4497-a159-ff82e03811c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:36.525274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c8821280-b364-4497-a159-ff82e03811c7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:36.526813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c8821280-b364-4497-a159-ff82e03811c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:36.536266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 3/7] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:36.565279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bda21-4def-455d-91fa-cf2fb703964c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:36.579965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bda21-4def-455d-91fa-cf2fb703964c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:36.585237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2af84-b23c-42cf-be66-686143f52cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:36.585873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2af84-b23c-42cf-be66-686143f52cef admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:36.586156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2af84-b23c-42cf-be66-686143f52cef admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:36.586429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2af84-b23c-42cf-be66-686143f52cef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:36.594862 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2af84-b23c-42cf-be66-686143f52cef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:36.596704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2af84-b23c-42cf-be66-686143f52cef admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:36.606324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 5/8] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:36.613245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8821280-b364-4497-a159-ff82e03811c7 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:36.629043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8821280-b364-4497-a159-ff82e03811c7 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:36.638457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e66a2-f50d-44ae-83ba-771c286beb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:36.639873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e66a2-f50d-44ae-83ba-771c286beb93 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:36.640342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e66a2-f50d-44ae-83ba-771c286beb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:36.640799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e66a2-f50d-44ae-83ba-771c286beb93 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:36.643213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e66a2-f50d-44ae-83ba-771c286beb93 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:36.645133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e66a2-f50d-44ae-83ba-771c286beb93 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:36.646654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 4/9] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:36 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:38.862427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ae74c-70f7-49d1-b549-84b43e00ec5a None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:38.863023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ae74c-70f7-49d1-b549-84b43e00ec5a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:38.863023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ae74c-70f7-49d1-b549-84b43e00ec5a None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:38.864791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:38.872408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9544-ddbf-44c9-ad06-5cae7a1668ea None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:38.873140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9544-ddbf-44c9-ad06-5cae7a1668ea None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:38.873140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9544-ddbf-44c9-ad06-5cae7a1668ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:38.881653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb484-caa2-45fd-bc87-d3376e942cfb None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:38.882009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb484-caa2-45fd-bc87-d3376e942cfb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:38.882386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdb484-caa2-45fd-bc87-d3376e942cfb None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:38.885174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 7/11] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:38.894049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:38.894336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:38.894611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:38.897782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-643c9544-ddbf-44c9-ad06-5cae7a1668ea None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:38.899004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-643c9544-ddbf-44c9-ad06-5cae7a1668ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:38.908031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 5/12] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:38.932456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9544-ddbf-44c9-ad06-5cae7a1668ea None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:38.940577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG passlib.handlers.bcrypt [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73390) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 03:16:38.941004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG passlib.handlers.bcrypt [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73390) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 03:16:38.942336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9544-ddbf-44c9-ad06-5cae7a1668ea None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:38.947237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:38.948052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:38.948334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:38.948599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:38.961966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:38.968643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:16:38.969844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 6/13] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:16:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:38.976814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:38.986292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436876b0-bdc8-462a-bcb3-7668811e221d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:38.986477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:38.988169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:38.991190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:38.991834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:38.992117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:38.992384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:38.993127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:38.993432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:38.995171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:38.995171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:16:38.995171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:16:38.996097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:39.009385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:39.015506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:39.025251 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8c659-0ba1-4d8b-871b-f55092d7b4ae admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:39.025588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 8/15] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:16:39.029933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:39.030885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:39.031183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:39.031486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:39.032772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:39.034588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:39.036143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 8/16] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:39 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:39.042356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:39.048100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:39.053262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96fc8-ac5c-4fa5-86b6-63263002e622 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:39.058162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65b092-9123-43cd-812c-a57f71d92ee5 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:39.059416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:39.060641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:39.060929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:39.061225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:39.062966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:39.063215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:39.063856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:39.064201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:39.064647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:39.065469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:39.067073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:39.072499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:39.073373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:39.074261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:39.083462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 9/18] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:16:39.083695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713f6ea-c516-428e-af81-cc0ed64f4671 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:39.089140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:39.089285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:39.089778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:39.090066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:39.090351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:39.091182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.domain.id=default, user.id=7fef28dc8c914392b02ef34cf0bcbb9c) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:39.091498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:39.093228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:39.093228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:16:39.093228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:16:39.094379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c1ed9-a2d8-4b66-bd51-7d45baa5f1ef admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:39.098330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d21f2a-b31f-49fc-97bd-7e500094cd91 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:39.102831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af8ad7-8fba-4673-9887-b2c4f3d0eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:39.103623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8ad7-8fba-4673-9887-b2c4f3d0eb8d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:39.103904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8ad7-8fba-4673-9887-b2c4f3d0eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:39.103987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1344 bytes} [Fri Aug 27 03:16:39 2021] GET /identity/v3/role_assignments?user.id=7fef28dc8c914392b02ef34cf0bcbb9c&scope.domain.id=default&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:39.104176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af8ad7-8fba-4673-9887-b2c4f3d0eb8d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:39.105431 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af8ad7-8fba-4673-9887-b2c4f3d0eb8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:39.107182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af8ad7-8fba-4673-9887-b2c4f3d0eb8d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:39.108843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 10/20] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:41.646172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac07d-728e-4d55-b416-a154f269749b None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.647290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac07d-728e-4d55-b416-a154f269749b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.647806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac07d-728e-4d55-b416-a154f269749b None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:41.650191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:41.657250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc1ceb-d44e-40b9-92df-4d64dcf35e82 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.658270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc1ceb-d44e-40b9-92df-4d64dcf35e82 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.658775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc1ceb-d44e-40b9-92df-4d64dcf35e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:41.684463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d6cc1ceb-d44e-40b9-92df-4d64dcf35e82 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:41.686068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d6cc1ceb-d44e-40b9-92df-4d64dcf35e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:41.698775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 11/22] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:41.738097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac07d-728e-4d55-b416-a154f269749b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:41.754008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac07d-728e-4d55-b416-a154f269749b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:41.758333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:41.759005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.759282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.759621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:41.760389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:41.761411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:41.761411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:16:41.761411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:16:41.762317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:41.773970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c95af-6015-4fa0-918d-c368ce93c96a None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.774718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c95af-6015-4fa0-918d-c368ce93c96a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.775195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c95af-6015-4fa0-918d-c368ce93c96a None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:41.777470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 12/23] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:16:41.784208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234cc9-3f8c-45d9-8ddb-09ee1909fd33 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.784746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234cc9-3f8c-45d9-8ddb-09ee1909fd33 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.785275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234cc9-3f8c-45d9-8ddb-09ee1909fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:41.823630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c7234cc9-3f8c-45d9-8ddb-09ee1909fd33 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:41.825226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c7234cc9-3f8c-45d9-8ddb-09ee1909fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:41.846193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 13/24] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:16:41.880368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc6ab1-8174-4e02-8047-3eee602bc06d None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.880934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc6ab1-8174-4e02-8047-3eee602bc06d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.881488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc6ab1-8174-4e02-8047-3eee602bc06d None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:41.888278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 14/25] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:41 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:41.889242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc6ab1-8174-4e02-8047-3eee602bc06d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:41.909596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc6ab1-8174-4e02-8047-3eee602bc06d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:41.924168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457059b0-a17b-4162-889b-5741f44f94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:41.925314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457059b0-a17b-4162-889b-5741f44f94c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.925825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457059b0-a17b-4162-889b-5741f44f94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.926297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457059b0-a17b-4162-889b-5741f44f94c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:41.944642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457059b0-a17b-4162-889b-5741f44f94c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:41.946958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457059b0-a17b-4162-889b-5741f44f94c2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:41.976215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-457059b0-a17b-4162-889b-5741f44f94c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:16:41.984194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 15/26] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:41.985801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ab463-5a55-42e1-ae6a-b32a28290c26 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:41.986295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ab463-5a55-42e1-ae6a-b32a28290c26 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:41.986872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ab463-5a55-42e1-ae6a-b32a28290c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.009984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 12/27] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:16:41 2021] POST /identity/v3/roles => generated 219 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:16:42.010987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.020718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f93ab463-5a55-42e1-ae6a-b32a28290c26 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:42.022289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f93ab463-5a55-42e1-ae6a-b32a28290c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:42.030612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68d11-4d13-4811-8f7a-341c8862130c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.043588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.044291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.044574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.044849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.045593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:42.045898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:42.046554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 16/28] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:42.047260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:42.047260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:16:42.047260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:16:42.048271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:42.082794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ab463-5a55-42e1-ae6a-b32a28290c26 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.089623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 13/29] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:16:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:42.095763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.097828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ab463-5a55-42e1-ae6a-b32a28290c26 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.106674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fe7b5-7e5a-49a9-a9e1-1da907a86e61 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.115502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.116191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.116477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.116757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.117102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.117496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:42.118327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.118526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:42.118526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:16:42.118526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:16:42.119122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.119625 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.119788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:42.137109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:42.149669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:16:42.150944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 17/30] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:16:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:42.158612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.175693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 14/31] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:16:42 2021] POST /identity/v3/projects => generated 301 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:16:42.181296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971bbbb-2354-4813-bffe-1bfe8ae9ef9b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.265410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.266661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.267323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.268139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.269334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:42.269880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:42.271859 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:42.281785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 18/32] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:42.288347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.310389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0306b0d-7f0b-4001-9f4a-f5197160f6a8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.319479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.320404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.320686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.320963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.322533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:42.324446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:42.326160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 15/33] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:42 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:42.333080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.343972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11befe64-f0ed-402a-9721-f2abde906898 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.356159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac66929-2010-4f01-92d3-35044a70c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.357359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66929-2010-4f01-92d3-35044a70c1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.357862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66929-2010-4f01-92d3-35044a70c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.358326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac66929-2010-4f01-92d3-35044a70c1d6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.359900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac66929-2010-4f01-92d3-35044a70c1d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:42.362350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac66929-2010-4f01-92d3-35044a70c1d6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:42.364367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 19/34] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:42.370712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.385542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c30bf0-447e-41f8-b6e8-82fb0d4addd9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.395725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643b8ed-f4f6-4fe4-8fbd-0aba878cda7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.396647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b8ed-f4f6-4fe4-8fbd-0aba878cda7c admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.396936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b8ed-f4f6-4fe4-8fbd-0aba878cda7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.397214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b8ed-f4f6-4fe4-8fbd-0aba878cda7c admin admin] PATH_INFO: `/v3/domains/default/users/7fef28dc8c914392b02ef34cf0bcbb9c/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.399283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643b8ed-f4f6-4fe4-8fbd-0aba878cda7c admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7fef28dc8c914392b02ef34cf0bcbb9c, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:42.400380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-4643b8ed-f4f6-4fe4-8fbd-0aba878cda7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:42.400380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:16:42.400380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:16:42.402382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643b8ed-f4f6-4fe4-8fbd-0aba878cda7c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:42.431755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 16/35] 10.222.0.58 () {58 vars in 1383 bytes} [Fri Aug 27 03:16:42 2021] PUT /identity/v3/domains/default/users/7fef28dc8c914392b02ef34cf0bcbb9c/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:16:42.563892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b24f0-cfaf-4f57-9540-912528117d1d None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.564343 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b24f0-cfaf-4f57-9540-912528117d1d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.564471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b24f0-cfaf-4f57-9540-912528117d1d None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.566321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 20/36] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:42.573139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de1943-98a2-46e0-9f10-cbd431931846 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.573431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de1943-98a2-46e0-9f10-cbd431931846 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.573711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de1943-98a2-46e0-9f10-cbd431931846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.597491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-96de1943-98a2-46e0-9f10-cbd431931846 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:42.599061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-96de1943-98a2-46e0-9f10-cbd431931846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:42.694735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 17/37] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:16:42.718044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b24f0-cfaf-4f57-9540-912528117d1d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:42.730756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b24f0-cfaf-4f57-9540-912528117d1d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:42.735041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72365517-e552-462d-a223-5dff1027760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:42.735872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365517-e552-462d-a223-5dff1027760a admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:42.736152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365517-e552-462d-a223-5dff1027760a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:42.736423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72365517-e552-462d-a223-5dff1027760a admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:42.737345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365517-e552-462d-a223-5dff1027760a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:42.738365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-72365517-e552-462d-a223-5dff1027760a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:42.738365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:16:42.738365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:16:42.739252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72365517-e552-462d-a223-5dff1027760a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:42.963594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 21/38] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:16:42 2021] POST /identity/v3/roles => generated 225 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:16:43.067134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752721b-072c-44a3-96e6-bbe035842e0b None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:43.067512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752721b-072c-44a3-96e6-bbe035842e0b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:43.067729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752721b-072c-44a3-96e6-bbe035842e0b None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:43.069857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 18/39] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:43.076350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2554e8-583d-45c5-ba5e-c7aa2b69121e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:43.076639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2554e8-583d-45c5-ba5e-c7aa2b69121e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:43.076912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2554e8-583d-45c5-ba5e-c7aa2b69121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:43.097386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5e2554e8-583d-45c5-ba5e-c7aa2b69121e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:43.098954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5e2554e8-583d-45c5-ba5e-c7aa2b69121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:43.107417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 22/40] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:43.131435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752721b-072c-44a3-96e6-bbe035842e0b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:43.144081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752721b-072c-44a3-96e6-bbe035842e0b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:43.149350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e232c4a-f5c7-4248-abb1-5649a22a760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:43.150029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e232c4a-f5c7-4248-abb1-5649a22a760d admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:43.150307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e232c4a-f5c7-4248-abb1-5649a22a760d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:43.150582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e232c4a-f5c7-4248-abb1-5649a22a760d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:43.151336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e232c4a-f5c7-4248-abb1-5649a22a760d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:43.153004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e232c4a-f5c7-4248-abb1-5649a22a760d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:43.168344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 19/41] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:16:43 2021] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:16:43.413435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668b822-464c-48cd-8486-c777885b0ce6 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:43.413721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668b822-464c-48cd-8486-c777885b0ce6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:43.413993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668b822-464c-48cd-8486-c777885b0ce6 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:43.415820 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 23/42] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:43.421893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424011-528e-4dcd-b2a2-c31c2b5a2e51 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:43.422185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424011-528e-4dcd-b2a2-c31c2b5a2e51 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:43.422461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d424011-528e-4dcd-b2a2-c31c2b5a2e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:43.441738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0d424011-528e-4dcd-b2a2-c31c2b5a2e51 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:43.442953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0d424011-528e-4dcd-b2a2-c31c2b5a2e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:43.451287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 20/43] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:43.475853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668b822-464c-48cd-8486-c777885b0ce6 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:43.490611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668b822-464c-48cd-8486-c777885b0ce6 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:43.495761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f10e6a-74ea-48d2-95f8-0b10d44d9967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:43.496652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f10e6a-74ea-48d2-95f8-0b10d44d9967 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:43.496941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f10e6a-74ea-48d2-95f8-0b10d44d9967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:43.497216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f10e6a-74ea-48d2-95f8-0b10d44d9967 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:43.498417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f10e6a-74ea-48d2-95f8-0b10d44d9967 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:43.500308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f10e6a-74ea-48d2-95f8-0b10d44d9967 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:43.502219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 24/44] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:43.508401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424011-528e-4dcd-b2a2-c31c2b5a2e51 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:43.518069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d424011-528e-4dcd-b2a2-c31c2b5a2e51 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:43.523164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ff119-3c3b-49a6-950d-5f847b96c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:43.523865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ff119-3c3b-49a6-950d-5f847b96c19e admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:43.524151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ff119-3c3b-49a6-950d-5f847b96c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:43.524432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ff119-3c3b-49a6-950d-5f847b96c19e admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:43.525156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ff119-3c3b-49a6-950d-5f847b96c19e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:43.527078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ff119-3c3b-49a6-950d-5f847b96c19e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:43.554638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 21/45] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:16:43 2021] POST /identity/v3/projects => generated 312 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:16:44.626821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa915d3-aa53-47af-be8c-de9c9742f2aa None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:44.627383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa915d3-aa53-47af-be8c-de9c9742f2aa None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:44.627469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa915d3-aa53-47af-be8c-de9c9742f2aa None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:44.629327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 25/46] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:44.635337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f391-d79a-4a18-b669-fb1d2dd44dc1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:44.635789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f391-d79a-4a18-b669-fb1d2dd44dc1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:44.635904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6f391-d79a-4a18-b669-fb1d2dd44dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:44.654507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b7a6f391-d79a-4a18-b669-fb1d2dd44dc1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:44.655695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b7a6f391-d79a-4a18-b669-fb1d2dd44dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:44.716324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 22/47] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:44.747394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa915d3-aa53-47af-be8c-de9c9742f2aa None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:44.768800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa915d3-aa53-47af-be8c-de9c9742f2aa None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:44.776225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:44.777272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:44.777743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:44.778022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:44.791242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:44.798069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:16:44.799572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 26/48] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:16:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:44.806221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6f391-d79a-4a18-b669-fb1d2dd44dc1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:44.816096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6f391-d79a-4a18-b669-fb1d2dd44dc1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:44.821214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:44.821942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:44.822230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:44.822557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:44.823379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:44.823742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:44.824822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:44.824822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:16:44.824822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:16:44.825823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:44.841428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 23/49] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:44.848004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:44.859071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb09a1-58e7-415b-afd9-b39e0f15da39 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:44.865005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:44.865955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:44.866311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:44.866659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:44.868026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:44.869958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:44.871635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 27/50] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:44 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:44.877508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:44.887678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd95e-bdb1-4230-9a6f-8d61bca69707 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:44.893440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ba5ec-efee-4c05-a3ca-db309be637ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:44.894230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba5ec-efee-4c05-a3ca-db309be637ef admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:44.894517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba5ec-efee-4c05-a3ca-db309be637ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:44.894802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ba5ec-efee-4c05-a3ca-db309be637ef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:44.896054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ba5ec-efee-4c05-a3ca-db309be637ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:44.897750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ba5ec-efee-4c05-a3ca-db309be637ef admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:44.899375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 24/51] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:44.905850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:44.916635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f551e0b-0257-4264-ae39-c8fd05101bc1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:44.921380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:44.922011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:44.922327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:44.922601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:44.923591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.domain.id=default, user.id=7fef28dc8c914392b02ef34cf0bcbb9c) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:44.923912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:44.925004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:44.925004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:16:44.925004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:16:44.926152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30e33d-d495-40a0-a482-a5cb1e1f78ff admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:44.933925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 28/52] 10.222.0.58 () {56 vars in 1344 bytes} [Fri Aug 27 03:16:44 2021] GET /identity/v3/role_assignments?user.id=7fef28dc8c914392b02ef34cf0bcbb9c&scope.domain.id=default&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 530 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:45.685413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e51aa-bb28-44b9-9503-3e7fdf477fca None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:45.686273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e51aa-bb28-44b9-9503-3e7fdf477fca None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:45.686273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e51aa-bb28-44b9-9503-3e7fdf477fca None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:45.689270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 25/53] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:45.699475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8734f-acba-429a-9c3a-fd7d558051da None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:45.699914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8734f-acba-429a-9c3a-fd7d558051da None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:45.700074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8734f-acba-429a-9c3a-fd7d558051da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:45.727718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-49b8734f-acba-429a-9c3a-fd7d558051da None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:45.729636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-49b8734f-acba-429a-9c3a-fd7d558051da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:45.741179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 29/54] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:45.764776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e51aa-bb28-44b9-9503-3e7fdf477fca None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:45.780377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e51aa-bb28-44b9-9503-3e7fdf477fca None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:45.786680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd7ce3-6c2d-4a5e-b230-7d3978f4e528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:45.787508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd7ce3-6c2d-4a5e-b230-7d3978f4e528 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:45.787740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd7ce3-6c2d-4a5e-b230-7d3978f4e528 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:45.788052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd7ce3-6c2d-4a5e-b230-7d3978f4e528 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:45.789350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd7ce3-6c2d-4a5e-b230-7d3978f4e528 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:45.791070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd7ce3-6c2d-4a5e-b230-7d3978f4e528 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:45.792694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 26/55] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:45.798726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8734f-acba-429a-9c3a-fd7d558051da None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:45.809563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8734f-acba-429a-9c3a-fd7d558051da None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:45.816066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a21e0-2015-497a-87d5-e6558ed0007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:45.816773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a21e0-2015-497a-87d5-e6558ed0007d admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:45.817098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a21e0-2015-497a-87d5-e6558ed0007d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:45.817419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a21e0-2015-497a-87d5-e6558ed0007d admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:45.818170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a21e0-2015-497a-87d5-e6558ed0007d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:45.819247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-336a21e0-2015-497a-87d5-e6558ed0007d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:45.819247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:16:45.819247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:16:45.820601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a21e0-2015-497a-87d5-e6558ed0007d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:45.854168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 30/56] 10.222.0.58 () {60 vars in 1162 bytes} [Fri Aug 27 03:16:45 2021] POST /identity/v3/projects => generated 298 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:16:47.989344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8e21-a534-4176-814c-2bd746d77835 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:47.989928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8e21-a534-4176-814c-2bd746d77835 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:47.989928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd8e21-a534-4176-814c-2bd746d77835 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:47.991713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 27/57] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:47.998667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c47c-5691-4aed-bdb0-ca7ed3f7444c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:47.999409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c47c-5691-4aed-bdb0-ca7ed3f7444c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:47.999590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c47c-5691-4aed-bdb0-ca7ed3f7444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:48.018798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-47c1c47c-5691-4aed-bdb0-ca7ed3f7444c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:48.020016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-47c1c47c-5691-4aed-bdb0-ca7ed3f7444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:48.080493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 31/58] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:48.106042 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd8e21-a534-4176-814c-2bd746d77835 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:48.120570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd8e21-a534-4176-814c-2bd746d77835 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:48.126177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a9cd-a39b-4b25-9800-53d31ce56fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:48.127002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a9cd-a39b-4b25-9800-53d31ce56fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:48.127282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a9cd-a39b-4b25-9800-53d31ce56fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:48.127590 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a9cd-a39b-4b25-9800-53d31ce56fe5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:48.128919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6a9cd-a39b-4b25-9800-53d31ce56fe5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:48.130617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6a9cd-a39b-4b25-9800-53d31ce56fe5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:48.132230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 28/59] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:48.138770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c47c-5691-4aed-bdb0-ca7ed3f7444c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:48.154347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c47c-5691-4aed-bdb0-ca7ed3f7444c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:48.161757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36bcc-ef91-4797-a8ce-9645d1ddfe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:48.162435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36bcc-ef91-4797-a8ce-9645d1ddfe28 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:48.162713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36bcc-ef91-4797-a8ce-9645d1ddfe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:48.162984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36bcc-ef91-4797-a8ce-9645d1ddfe28 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:48.163746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36bcc-ef91-4797-a8ce-9645d1ddfe28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:48.164792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-5aa36bcc-ef91-4797-a8ce-9645d1ddfe28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:48.164792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:16:48.164792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:16:48.166012 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36bcc-ef91-4797-a8ce-9645d1ddfe28 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:48.193498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 32/60] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:16:48 2021] POST /identity/v3/users => generated 275 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:16:51.541953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177253-6fdd-4464-8324-ccc7bb444156 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.542984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177253-6fdd-4464-8324-ccc7bb444156 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.543509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177253-6fdd-4464-8324-ccc7bb444156 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.545814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 29/61] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:51.552029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e4b0-63d4-4efc-afd9-7afe2801ee95 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.553914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef45a1-508e-448e-9415-8ad53f674207 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.554441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef45a1-508e-448e-9415-8ad53f674207 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.554910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef45a1-508e-448e-9415-8ad53f674207 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.557131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 30/62] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:51.558014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e4b0-63d4-4efc-afd9-7afe2801ee95 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.558499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e4b0-63d4-4efc-afd9-7afe2801ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.562719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed206d5-881e-484a-ad2c-ef5b739951f2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.563264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed206d5-881e-484a-ad2c-ef5b739951f2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.563810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed206d5-881e-484a-ad2c-ef5b739951f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.584154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8ed206d5-881e-484a-ad2c-ef5b739951f2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:51.585695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8ed206d5-881e-484a-ad2c-ef5b739951f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:51.588355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3062e4b0-63d4-4efc-afd9-7afe2801ee95 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:51.589552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3062e4b0-63d4-4efc-afd9-7afe2801ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:51.598170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 31/63] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:16:51.604792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 33/64] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:51.622587 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed206d5-881e-484a-ad2c-ef5b739951f2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.632364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed206d5-881e-484a-ad2c-ef5b739951f2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.636891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e4b0-63d4-4efc-afd9-7afe2801ee95 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.648104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.649815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e4b0-63d4-4efc-afd9-7afe2801ee95 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.650836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.651330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.651820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.663623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.664763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.665266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.665743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.676921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:51.684432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:16:51.686355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 32/65] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:51.691989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:51.692696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.699233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:16:51.703453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bb275-74fe-4f23-9db4-c438d3cf3d44 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.706352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 34/66] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:16:51.713934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.714619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.714903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.715179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.715969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:51.716278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.717967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.725194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.735504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc561-b7c8-46a5-a0ee-249c9c32c0dd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.740859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 33/67] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:51.747586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.754559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.755243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.755546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.755818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.756574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:51.756992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.758632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.765340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d927b6a-3168-49e6-b4ca-80cd476ba121 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.775160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 35/68] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:51.782353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.783395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.783754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.784081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.784388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.788099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.789966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.791657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:51.798937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df6fd-6635-45f0-8270-c28e638c8804 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.800085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.804133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.805260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.805681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.806091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.811191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2ece4-f200-46d2-b438-3437cc686448 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.821293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.823807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.825720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 36/70] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:51.826516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.827196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.827510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.827792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.834966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.844214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.847555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.850042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7459fd9-ca28-4002-85cf-40d498a22f79 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.859785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 35/71] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:51.863434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.864057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.864344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.864622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.867035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.876463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900838e0-dcb3-4fab-be6f-8f5e48aced3f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.881582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.882215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.883304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.883435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.883900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.884361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.885753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.888438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.890680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 36/72] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:51.898547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.902978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 37/73] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:16:51.909756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.910649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82df1f-014c-4d7b-96b5-4f730a86cd75 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.921889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a327fe-0fa1-47ac-b2fb-734230da6ba2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.923014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.924489 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.924991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.925496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.926624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b, user.id=7fef28dc8c914392b02ef34cf0bcbb9c) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:51.927150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.929424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.937830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 37/74] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/role_assignments?user.id=7fef28dc8c914392b02ef34cf0bcbb9c&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:51.942004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648f651-06d6-4d30-825f-3489c2cbe86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.942971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648f651-06d6-4d30-825f-3489c2cbe86f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.943267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648f651-06d6-4d30-825f-3489c2cbe86f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.943598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648f651-06d6-4d30-825f-3489c2cbe86f admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.948517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648f651-06d6-4d30-825f-3489c2cbe86f admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.951077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648f651-06d6-4d30-825f-3489c2cbe86f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.953754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:51.960795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:51.977610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a55be6-fdff-45ff-b5e3-c015effcc7db admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:51.982584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d746f5-3ed7-4b58-bafc-9e01658c14aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:51.983569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d746f5-3ed7-4b58-bafc-9e01658c14aa admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:51.984047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d746f5-3ed7-4b58-bafc-9e01658c14aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:51.984529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d746f5-3ed7-4b58-bafc-9e01658c14aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:51.985613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d746f5-3ed7-4b58-bafc-9e01658c14aa admin admin] RBAC: Adding query filter params (role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b, user.id=bb746cac3a914fd5a9829fbc109253e7) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:51.986134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d746f5-3ed7-4b58-bafc-9e01658c14aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:51.988219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d746f5-3ed7-4b58-bafc-9e01658c14aa admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:51.994567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 38/76] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:51 2021] GET /identity/v3/role_assignments?user.id=bb746cac3a914fd5a9829fbc109253e7&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:52.002066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d12495-c172-4f55-b2fa-1b5504d1dda6 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.002463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d12495-c172-4f55-b2fa-1b5504d1dda6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.002789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d12495-c172-4f55-b2fa-1b5504d1dda6 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.004898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 39/77] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:52.017934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5a9ae-1012-4cc9-9b8c-d669dc018b2f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.018604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5a9ae-1012-4cc9-9b8c-d669dc018b2f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.019081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5a9ae-1012-4cc9-9b8c-d669dc018b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.041271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42913c3-d181-4758-ad30-2652b234ca24 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.041935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42913c3-d181-4758-ad30-2652b234ca24 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.042419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42913c3-d181-4758-ad30-2652b234ca24 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.044544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 40/78] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:16:52.045097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-03e5a9ae-1012-4cc9-9b8c-d669dc018b2f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:52.046358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-03e5a9ae-1012-4cc9-9b8c-d669dc018b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:52.046596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648e68d-ed43-49a1-ad21-b3c51097c326 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.047072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648e68d-ed43-49a1-ad21-b3c51097c326 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.047591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648e68d-ed43-49a1-ad21-b3c51097c326 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.054522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 39/79] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:52.055946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698bfb-9031-4c5d-b9ed-a449426a4ae3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.056240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698bfb-9031-4c5d-b9ed-a449426a4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.056522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8698bfb-9031-4c5d-b9ed-a449426a4ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.057189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 41/80] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:52 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:52.064756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48a85-9ff1-426f-b4b6-36f303ec9f91 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.065381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48a85-9ff1-426f-b4b6-36f303ec9f91 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.065839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48a85-9ff1-426f-b4b6-36f303ec9f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.082315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e8698bfb-9031-4c5d-b9ed-a449426a4ae3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:52.084615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e8698bfb-9031-4c5d-b9ed-a449426a4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:52.093345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 40/81] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:52.105385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-fce48a85-9ff1-426f-b4b6-36f303ec9f91 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:52.105578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698bfb-9031-4c5d-b9ed-a449426a4ae3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.107150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-fce48a85-9ff1-426f-b4b6-36f303ec9f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:52.115824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8698bfb-9031-4c5d-b9ed-a449426a4ae3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.120600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.121422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.121705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.121979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.127639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 42/82] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:52.128553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48a85-9ff1-426f-b4b6-36f303ec9f91 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.140580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48a85-9ff1-426f-b4b6-36f303ec9f91 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.145807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:52.156194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.156933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.157216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.157538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.158724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:16:52.160408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 41/83] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:16:52.160945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.161221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.163578 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.165660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 43/84] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:52.167538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.176536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68117eb6-ff31-4753-931d-4af358cc247c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.182001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7d802-0e60-48b1-92dc-dc6cebbb6d57 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.185730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.186553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.186846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.187125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.188076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.188816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.189100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.189374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.190126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:52.190433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.192219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.198704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:52.201148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 44/85] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:52.201945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.211725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee013433-c646-47a6-848d-2853bfdc2218 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.212305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:16:52.213563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 42/86] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:52.214350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.222187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.222860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.223141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.223453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.224176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.224633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e4e61-56fa-4a93-a49b-8fb5caee14cc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.226254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.229222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.230078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.230364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.230638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.231917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.234076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.235801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 43/87] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:52.236733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.252901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bc114-99fb-40ef-9bd1-646c3675ff12 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.254269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 45/88] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:16:52 2021] POST /identity/v3/projects => generated 302 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:16:52.255264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.313594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.314891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.315106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.315294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.316032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:52.316345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.318019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.322107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708c242-74f0-43dc-82e9-c5c25e14af78 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.327245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.327756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 44/89] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:52.327991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.328274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.328546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.334148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.338424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.340264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.343876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2c4f-6830-44ed-b061-8990d42ae862 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.348688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.349668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.349952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.350211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 46/90] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:52.350543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.351826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.354028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.355986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 45/91] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:52.357062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.362805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.367321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09751f-2d9c-42c9-a2c1-c4b99f76b4d8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.372948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb78f63-9996-4800-8420-a9bba96eb2ad admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.376963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.377866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.378197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.378383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.378548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] PATH_INFO: `/v3/projects/2459305174fb41a1b648a70650c64c30` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.378859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.379150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.379458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.379727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] RBAC: Authorizing `identity:get_project(project_id=2459305174fb41a1b648a70650c64c30)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.382129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.387411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 47/92] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/projects/2459305174fb41a1b648a70650c64c30 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:52.396677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.408531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.410812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.419404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20a54a-b256-4270-8280-8fe3c85e1f23 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.432036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 46/93] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:52.433864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.434737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.435175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.435653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.436624 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] RBAC: Adding query filter params (role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=2459305174fb41a1b648a70650c64c30, user.id=bb746cac3a914fd5a9829fbc109253e7) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:52.437073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.439886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.444914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.453085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 48/94] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/role_assignments?user.id=bb746cac3a914fd5a9829fbc109253e7&scope.project.id=2459305174fb41a1b648a70650c64c30&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:52.459992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4788-883f-4777-9000-5c53fe3808cf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.475793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad5a7-8661-4cb7-970f-31406cbd9834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.476705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad5a7-8661-4cb7-970f-31406cbd9834 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.476990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad5a7-8661-4cb7-970f-31406cbd9834 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.477266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad5a7-8661-4cb7-970f-31406cbd9834 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.478622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad5a7-8661-4cb7-970f-31406cbd9834 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.480804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad5a7-8661-4cb7-970f-31406cbd9834 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.482682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 47/95] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:52.489910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:52.503189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9fc11-8174-4831-be18-6e57c2d89142 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:52.515139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f3a17-6f4e-45e0-b22d-dc52a97c657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:52.516242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3a17-6f4e-45e0-b22d-dc52a97c657b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:52.516716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3a17-6f4e-45e0-b22d-dc52a97c657b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:52.517348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3a17-6f4e-45e0-b22d-dc52a97c657b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:52.518431 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f3a17-6f4e-45e0-b22d-dc52a97c657b admin admin] RBAC: Adding query filter params (role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b, user.id=bb746cac3a914fd5a9829fbc109253e7) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:52.518937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f3a17-6f4e-45e0-b22d-dc52a97c657b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:52.521107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f3a17-6f4e-45e0-b22d-dc52a97c657b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:52.527718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 49/96] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:52 2021] GET /identity/v3/role_assignments?user.id=bb746cac3a914fd5a9829fbc109253e7&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:54.397313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aba97-eaf6-455f-a52f-3cfd3bffc5cf None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.397748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aba97-eaf6-455f-a52f-3cfd3bffc5cf None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.397935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aba97-eaf6-455f-a52f-3cfd3bffc5cf None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.399952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 48/97] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:54.405813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca9879-50ef-4168-803f-e84f062af3a3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.406376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca9879-50ef-4168-803f-e84f062af3a3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.406376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca9879-50ef-4168-803f-e84f062af3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.426512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-66ca9879-50ef-4168-803f-e84f062af3a3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:54.427765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-66ca9879-50ef-4168-803f-e84f062af3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:54.446187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 50/98] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:54.470633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aba97-eaf6-455f-a52f-3cfd3bffc5cf None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.489477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aba97-eaf6-455f-a52f-3cfd3bffc5cf None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.499443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.500256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.500543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.500826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.520084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:54.526887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:16:54.527692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f6310-3f7f-4668-b04c-f4b8c82b0443 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.527980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f6310-3f7f-4668-b04c-f4b8c82b0443 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.528408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 49/99] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:54.528561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f6310-3f7f-4668-b04c-f4b8c82b0443 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.530135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 51/100] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:16:54.534498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.537263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e875a1-13d5-4c9b-8e28-ea89031426e3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.537554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e875a1-13d5-4c9b-8e28-ea89031426e3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.537832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e875a1-13d5-4c9b-8e28-ea89031426e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.551008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9514f-f923-4d77-bb77-5b1218217ae5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.559626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.560300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.560585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.560858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.561869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b8e875a1-13d5-4c9b-8e28-ea89031426e3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:54.562044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:54.562356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.563044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b8e875a1-13d5-4c9b-8e28-ea89031426e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:54.564080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.573658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 50/101] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:54.577764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 52/102] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:54.580357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.590264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76331bc-e00e-491e-bf27-2c6ccf276fc9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.601429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.602313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.602597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.602873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.607622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.609520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.611568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 51/103] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:54.617850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e875a1-13d5-4c9b-8e28-ea89031426e3 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.618363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.628063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e875a1-13d5-4c9b-8e28-ea89031426e3 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.628330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f198b2-06c0-4bc2-8e54-88833ac0ad51 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.632498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.633438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.633725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.633996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.635200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.637558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.639759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 53/104] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:54.642180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.642983 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.643262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.643568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.649806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.655792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:54.663435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:16:54.664926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 52/105] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:16:54.666897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501c6d6-3276-4420-8488-70a132d6ad02 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.672268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.681466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.682378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.682566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484bebf-1568-4a42-90a6-f526ca8ad9ea admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.682671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.683235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/users/7fef28dc8c914392b02ef34cf0bcbb9c/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.691398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb3a0e4cb1d4b259b17107aefbb397b, user_id=7fef28dc8c914392b02ef34cf0bcbb9c, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.691398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:16:54.691398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:16:54.691398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:16:54.691398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.695385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.696078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.696364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.696642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.697405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] RBAC: Adding query filter params (name=member) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:54.697717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.699336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.715641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 54/106] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:16:54 2021] PUT /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/users/7fef28dc8c914392b02ef34cf0bcbb9c/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:16:54.717996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 53/107] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:54.724975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.815612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e691-8dc2-4b91-b263-733d98215e74 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.820514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.821411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.821698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.821978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.823203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.825637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.827699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 55/108] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:54.836600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.852907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a0154-0f12-4b24-aa3e-7797b21155be admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.857526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0a6e8-6955-40d4-bb95-99605c26fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.858409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0a6e8-6955-40d4-bb95-99605c26fcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.858691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0a6e8-6955-40d4-bb95-99605c26fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.858959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0a6e8-6955-40d4-bb95-99605c26fcd8 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.860216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0a6e8-6955-40d4-bb95-99605c26fcd8 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.862440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0a6e8-6955-40d4-bb95-99605c26fcd8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.872548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 54/109] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:54 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:54.879387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:54.891501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78d09-2cb1-4e9b-992e-851daabc1445 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:54.905300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68288-b2e4-4961-b15d-bd79fcb9c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:54.906140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68288-b2e4-4961-b15d-bd79fcb9c24b admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:54.906422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68288-b2e4-4961-b15d-bd79fcb9c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:54.906698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68288-b2e4-4961-b15d-bd79fcb9c24b admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/users/bb746cac3a914fd5a9829fbc109253e7/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:54.912775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68288-b2e4-4961-b15d-bd79fcb9c24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb3a0e4cb1d4b259b17107aefbb397b, user_id=bb746cac3a914fd5a9829fbc109253e7, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:54.915550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb68288-b2e4-4961-b15d-bd79fcb9c24b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:54.934045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 56/110] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:16:54 2021] PUT /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/users/bb746cac3a914fd5a9829fbc109253e7/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:16:55.193206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ade6d-a1d5-49b1-9406-c52898d7b4bc None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.193505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ade6d-a1d5-49b1-9406-c52898d7b4bc None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.193856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ade6d-a1d5-49b1-9406-c52898d7b4bc None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.195696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 55/111] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:55.202189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37e23-95d2-4411-b277-7f1617ee56f2 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.202485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37e23-95d2-4411-b277-7f1617ee56f2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.202771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37e23-95d2-4411-b277-7f1617ee56f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.228074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-56e37e23-95d2-4411-b277-7f1617ee56f2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:55.229677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-56e37e23-95d2-4411-b277-7f1617ee56f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:55.302955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47a22a-187b-49b2-8ca9-770e07c840e7 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.303304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47a22a-187b-49b2-8ca9-770e07c840e7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.303540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47a22a-187b-49b2-8ca9-770e07c840e7 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.305619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 56/112] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:16:55.312991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f7f1-2ed1-4779-b5db-dcc69d6d31c5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.313388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f7f1-2ed1-4779-b5db-dcc69d6d31c5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.313777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f7f1-2ed1-4779-b5db-dcc69d6d31c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.315691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 57/113] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:55.348436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-32d0f7f1-2ed1-4779-b5db-dcc69d6d31c5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:55.350053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-32d0f7f1-2ed1-4779-b5db-dcc69d6d31c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:55.351166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37e23-95d2-4411-b277-7f1617ee56f2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.363095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37e23-95d2-4411-b277-7f1617ee56f2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.371044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 57/114] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:55.375367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaaa63-4aa9-4272-acef-1ea9b69e3fc4 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.375367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaaa63-4aa9-4272-acef-1ea9b69e3fc4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.375367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaaa63-4aa9-4272-acef-1ea9b69e3fc4 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.375621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.375839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.379378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.379378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.382210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 58/115] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:55 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:55.391371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86370ced-1543-4e83-8852-5b2d08288941 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.391371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86370ced-1543-4e83-8852-5b2d08288941 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.391371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86370ced-1543-4e83-8852-5b2d08288941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.403867 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:55.409029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-86370ced-1543-4e83-8852-5b2d08288941 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:55.410936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-86370ced-1543-4e83-8852-5b2d08288941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:55.412208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:16:55.413461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 58/116] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:16:55.414215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.421367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 59/117] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:55.422078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86370ced-1543-4e83-8852-5b2d08288941 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.434099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5583-5350-41e3-8e96-2bfc1e872590 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.444190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.445868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.446424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86370ced-1543-4e83-8852-5b2d08288941 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.447259 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.448154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.455902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.456604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.456893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.457173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.458249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:55.458562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.460661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.464611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:55.469789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 60/118] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:55.471046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.473451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:16:55.475316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 59/119] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:55.476565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.485445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772025a8-af17-4ec0-80f6-e656d02ec0f6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.491277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.492112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.492395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.492678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.493466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d879d8-2d69-4cee-a3b8-e38a7e96019a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.494018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.495954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.502619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 61/120] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:55.502619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.503899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.504812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.505109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.505377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.508141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.510821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.513197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 60/121] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:55.515465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.520911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b67918-30de-4ec4-9924-90f955cb2e55 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.528448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.529108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.529398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.529680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.530429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:55.530741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.532394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.534021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2891c90-e21a-4f6c-a9d1-07ae3d0b6d7a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.539905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.540872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.541197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 62/122] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:55.541599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.542001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.542379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.543459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.545705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.556369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772498-0a79-42af-a50c-6bc369e46782 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.562689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.563793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.564146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.564670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.565847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.568118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.569892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 63/123] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:55.575313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.575456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 61/124] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:16:55 2021] POST /identity/v3/users => generated 283 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:16:55.576402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.592525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed21124-45fd-4cdf-8168-ae14b3201a65 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.598622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15b952-0b81-49e5-a90e-7dc7b63d6bc4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.602315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.603221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.603550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.603819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.605069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.607342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.609661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 64/125] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:55.614189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e47a6-8055-482e-9e12-2fc4f264c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.615125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e47a6-8055-482e-9e12-2fc4f264c5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.615432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e47a6-8055-482e-9e12-2fc4f264c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.615713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e47a6-8055-482e-9e12-2fc4f264c5b2 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/users/bb746cac3a914fd5a9829fbc109253e7/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.616050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.621387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e47a6-8055-482e-9e12-2fc4f264c5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb3a0e4cb1d4b259b17107aefbb397b, user_id=bb746cac3a914fd5a9829fbc109253e7, role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.624216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e47a6-8055-482e-9e12-2fc4f264c5b2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.626407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de80241-472e-47cd-bb2a-81807e834c6f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.631172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.632121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.632522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.632829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] PATH_INFO: `/v3/projects/2459305174fb41a1b648a70650c64c30` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.634084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2459305174fb41a1b648a70650c64c30)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.636234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.638167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 65/126] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:55 2021] GET /identity/v3/projects/2459305174fb41a1b648a70650c64c30 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:55.645337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:55.655260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12d903-6d9e-4013-9bf3-736465c2dac3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:55.661701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 62/127] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:16:55 2021] PUT /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/users/bb746cac3a914fd5a9829fbc109253e7/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:16:55.748503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d8fa-7ac4-4c42-81cb-3b3598226724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:55.749438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d8fa-7ac4-4c42-81cb-3b3598226724 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:55.749719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d8fa-7ac4-4c42-81cb-3b3598226724 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:55.750001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d8fa-7ac4-4c42-81cb-3b3598226724 admin admin] PATH_INFO: `/v3/projects/2459305174fb41a1b648a70650c64c30/users/bb746cac3a914fd5a9829fbc109253e7/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:55.756448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453d8fa-7ac4-4c42-81cb-3b3598226724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2459305174fb41a1b648a70650c64c30, user_id=bb746cac3a914fd5a9829fbc109253e7, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:55.759199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453d8fa-7ac4-4c42-81cb-3b3598226724 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:55.778120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 66/128] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:16:55 2021] PUT /identity/v3/projects/2459305174fb41a1b648a70650c64c30/users/bb746cac3a914fd5a9829fbc109253e7/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:16:57.279243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5026f-4d2f-47a7-aabd-3df52b0c63a8 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.280159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5026f-4d2f-47a7-aabd-3df52b0c63a8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.280575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5026f-4d2f-47a7-aabd-3df52b0c63a8 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.282842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 63/129] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:57.288957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55271a95-7ab4-4f37-b2e5-28bd00816224 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.289411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55271a95-7ab4-4f37-b2e5-28bd00816224 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.289498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55271a95-7ab4-4f37-b2e5-28bd00816224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.316492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-55271a95-7ab4-4f37-b2e5-28bd00816224 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:57.317804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-55271a95-7ab4-4f37-b2e5-28bd00816224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:57.393116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 67/130] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:57.433376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5026f-4d2f-47a7-aabd-3df52b0c63a8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.460996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5026f-4d2f-47a7-aabd-3df52b0c63a8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.465738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fc9cb-5be2-4bc9-9603-8d64426c0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.466720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fc9cb-5be2-4bc9-9603-8d64426c0e0b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.467234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fc9cb-5be2-4bc9-9603-8d64426c0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.467658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fc9cb-5be2-4bc9-9603-8d64426c0e0b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.483334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fc9cb-5be2-4bc9-9603-8d64426c0e0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:57.490790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-888fc9cb-5be2-4bc9-9603-8d64426c0e0b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:16:57.492687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 64/131] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:57.498799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55271a95-7ab4-4f37-b2e5-28bd00816224 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.501209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7f530-84ce-482a-9f26-14a0802a4e2f None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.501649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7f530-84ce-482a-9f26-14a0802a4e2f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.502064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7f530-84ce-482a-9f26-14a0802a4e2f None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.504083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 65/132] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:16:57.510349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab262852-a42e-4741-a77c-a7ce79f8ddc8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.510824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab262852-a42e-4741-a77c-a7ce79f8ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.511239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab262852-a42e-4741-a77c-a7ce79f8ddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.512426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55271a95-7ab4-4f37-b2e5-28bd00816224 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.527797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.528748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.529173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.529641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.530638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:57.531147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.533162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.547098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ab262852-a42e-4741-a77c-a7ce79f8ddc8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:57.551201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 68/133] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:57.551440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ab262852-a42e-4741-a77c-a7ce79f8ddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:57.558367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.572300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 66/134] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:16:57.573179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3de5-eaaa-4f28-97f0-63af4ab77fa2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.583630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.584732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.585151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.585577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.586927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.588925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.590678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 69/135] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:57.596854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab262852-a42e-4741-a77c-a7ce79f8ddc8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.606738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab262852-a42e-4741-a77c-a7ce79f8ddc8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.614699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.621414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.622247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.623686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.624128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.629706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e6fd0-bd66-444f-96aa-c5767acd6bcd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.639034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.641102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.649156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.649156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.649156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.649156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.655053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 67/136] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:57.661262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.667825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:57.672580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0653d7f-9945-450d-8db0-5f5d55ac06c5 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.676962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:16:57.678302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 70/137] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:16:57.683626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.684674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.685094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.685300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.685646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.686974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.689309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.691478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 68/138] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:57.696662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936539a-079e-43eb-bb07-130b46e37214 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.697708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.707371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.707371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.707371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.707371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.707765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:57.707765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.708957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.717724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ceda8-d58c-4a92-aa59-258db8c38224 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.719313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 71/139] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:57.725799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.732946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.733810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.734249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.734673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.735967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b, user.id=7fef28dc8c914392b02ef34cf0bcbb9c) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:57.736428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.736985 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97d35-8113-4e15-b123-ef066d5c5119 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.738666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.746459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.747673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.748057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.748440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.749389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 69/140] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/role_assignments?user.id=7fef28dc8c914392b02ef34cf0bcbb9c&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:57.749961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.752466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.754380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 72/141] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:57.761628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.776415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4806f23-8172-4c75-b8a4-86eba6be8b5d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.787408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.788350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.788780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.789198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.806066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.808520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.821058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 70/142] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:57.828609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.842592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de28435-81c1-4783-997b-8a3a2ad877a2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.850835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e851e8-107a-4635-ba4c-54fe0e6d24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.851833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e851e8-107a-4635-ba4c-54fe0e6d24be admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.852120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e851e8-107a-4635-ba4c-54fe0e6d24be admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.852401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e851e8-107a-4635-ba4c-54fe0e6d24be admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.853684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e851e8-107a-4635-ba4c-54fe0e6d24be admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.855846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e851e8-107a-4635-ba4c-54fe0e6d24be admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.857547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 73/143] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:57.864586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:57.876727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea701-e163-4aca-8e3e-4e28f21d8824 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:57.887555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0321f3-b798-4c91-b8c5-ed1b6955ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:57.888505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0321f3-b798-4c91-b8c5-ed1b6955ef81 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:57.888933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0321f3-b798-4c91-b8c5-ed1b6955ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:57.889367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0321f3-b798-4c91-b8c5-ed1b6955ef81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:57.890376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0321f3-b798-4c91-b8c5-ed1b6955ef81 admin admin] RBAC: Adding query filter params (role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b, user.id=bb746cac3a914fd5a9829fbc109253e7) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:57.890842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0321f3-b798-4c91-b8c5-ed1b6955ef81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:57.892990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0321f3-b798-4c91-b8c5-ed1b6955ef81 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:57.904179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 71/144] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:57 2021] GET /identity/v3/role_assignments?user.id=bb746cac3a914fd5a9829fbc109253e7&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:58.869182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21cb5-f6a4-4fb5-8451-d57676571740 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:58.869182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21cb5-f6a4-4fb5-8451-d57676571740 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:58.869182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af21cb5-f6a4-4fb5-8451-d57676571740 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:58.869182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 74/145] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:58.876200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e7d1c-e6e5-4c23-a99f-ab87a2e887c2 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:58.877368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e7d1c-e6e5-4c23-a99f-ab87a2e887c2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:58.877960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e7d1c-e6e5-4c23-a99f-ab87a2e887c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:58.904502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-839e7d1c-e6e5-4c23-a99f-ab87a2e887c2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:58.906042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-839e7d1c-e6e5-4c23-a99f-ab87a2e887c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:58.914555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 72/146] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:16:58.961718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21cb5-f6a4-4fb5-8451-d57676571740 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:58.976326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af21cb5-f6a4-4fb5-8451-d57676571740 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:58.986988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:58.988112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:58.988603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:58.989092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.004722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:59.012210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:16:59.013655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 75/147] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:16:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:59.020899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e7d1c-e6e5-4c23-a99f-ab87a2e887c2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.030418 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e7d1c-e6e5-4c23-a99f-ab87a2e887c2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.039599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.040609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.041094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.041575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.042805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:59.043334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.045207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.056755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 73/148] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.063323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.074574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6798635-767d-4dd5-a985-3529d4e8efa4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.083538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.084706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.085315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.085803 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.087209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.089583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.091439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 76/149] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.097876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.108307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7849a9-a51c-445f-967f-6bafc4be098f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.115433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.116326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.116848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.117313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.131250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.133393 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.149023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 74/150] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:59.155835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.168068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79710ee9-4242-4cd8-8a1c-e254d8f7c155 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.176909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267824c-5bd7-4fa9-a8eb-36c2bef5afbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.178077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267824c-5bd7-4fa9-a8eb-36c2bef5afbb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.178582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267824c-5bd7-4fa9-a8eb-36c2bef5afbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.179067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267824c-5bd7-4fa9-a8eb-36c2bef5afbb admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.180510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267824c-5bd7-4fa9-a8eb-36c2bef5afbb admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.183175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267824c-5bd7-4fa9-a8eb-36c2bef5afbb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.185330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 77/151] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.191830 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.201941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c94fc-5f0b-4c7c-a3f7-ab7b823d7f1d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.211400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7b0c-9893-45c2-ad80-c8261d661f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.212080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7b0c-9893-45c2-ad80-c8261d661f03 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.212361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7b0c-9893-45c2-ad80-c8261d661f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.212630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7b0c-9893-45c2-ad80-c8261d661f03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.213472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7b0c-9893-45c2-ad80-c8261d661f03 admin admin] RBAC: Adding query filter params (role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b, user.id=bb746cac3a914fd5a9829fbc109253e7) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:59.213782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7b0c-9893-45c2-ad80-c8261d661f03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.215681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7b0c-9893-45c2-ad80-c8261d661f03 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.228370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 75/152] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/role_assignments?user.id=bb746cac3a914fd5a9829fbc109253e7&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.421577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d405b2b-b485-4691-83c7-5826e16cc444 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.422248 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d405b2b-b485-4691-83c7-5826e16cc444 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.422776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d405b2b-b485-4691-83c7-5826e16cc444 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.425083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 78/153] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:59.431796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9990-ac64-45bf-a741-a9ea013c096b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.432424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9990-ac64-45bf-a741-a9ea013c096b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.433216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9990-ac64-45bf-a741-a9ea013c096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.452821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0dbb9990-ac64-45bf-a741-a9ea013c096b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:59.454599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0dbb9990-ac64-45bf-a741-a9ea013c096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:59.463662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 76/154] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:16:59.490020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d405b2b-b485-4691-83c7-5826e16cc444 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.503689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d405b2b-b485-4691-83c7-5826e16cc444 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.508704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a370a-f41f-46ac-8208-9d5d4aebba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.509777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a370a-f41f-46ac-8208-9d5d4aebba39 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.510327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a370a-f41f-46ac-8208-9d5d4aebba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.510790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a370a-f41f-46ac-8208-9d5d4aebba39 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.522662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a370a-f41f-46ac-8208-9d5d4aebba39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:59.529945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-4e8a370a-f41f-46ac-8208-9d5d4aebba39 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:16:59.531421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 79/155] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:59.538316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9990-ac64-45bf-a741-a9ea013c096b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.548249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9990-ac64-45bf-a741-a9ea013c096b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.553449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.554365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.554844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.555342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.556387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:59.557645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.558652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ba4d-8199-43de-b331-30a84dc82259 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.559125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ba4d-8199-43de-b331-30a84dc82259 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.559583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ba4d-8199-43de-b331-30a84dc82259 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.560032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.562039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 80/156] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:16:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:16:59.569507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a497f1-c91e-47d1-88eb-5e6f8610c446 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.570036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a497f1-c91e-47d1-88eb-5e6f8610c446 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.570483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a497f1-c91e-47d1-88eb-5e6f8610c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.576510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 77/157] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.583193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.591553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-45a497f1-c91e-47d1-88eb-5e6f8610c446 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:16:59.593083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-45a497f1-c91e-47d1-88eb-5e6f8610c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:16:59.601780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 81/158] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:16:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:16:59.605365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156d04-5a68-4748-ace8-fbdab44bef19 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.613408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.614297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.614582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.614856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] PATH_INFO: `/v3/users/38b18dde844743d58215f4178220d7e6` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.630846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a497f1-c91e-47d1-88eb-5e6f8610c446 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.635309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=38b18dde844743d58215f4178220d7e6)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.637531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.641071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a497f1-c91e-47d1-88eb-5e6f8610c446 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.646986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 78/159] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/users/38b18dde844743d58215f4178220d7e6 => generated 283 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.648428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.652364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.653457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.653942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.654463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.667168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d151498-e98a-4acc-8e5a-8406718041a3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.669775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:16:59.678446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.679442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.679969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.680441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.685715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:16:59.689497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 82/160] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:16:59.699383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.701526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.707815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.713033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 79/161] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:16:59.720343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a0281-f8e6-4164-a50a-0ab94dabe996 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.720937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.725481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.726394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.726902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.727429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.728469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:59.729032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.729903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3ec4f-377d-458a-934b-428f9c420c4e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.731312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.743419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 83/162] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:59.746590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.748693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.748693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.748693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.749630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.752070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.754117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 80/163] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:59.759478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.760816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.771853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64488b72-2822-482a-acda-e794aba74ddf admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.774730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f746962-e1c1-477f-a75f-c5cea440099d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.784034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.785082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.785566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.786014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.786515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.787262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] RBAC: Adding query filter params (role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=5f106e34074d41a083ed6d551071767f, user.id=38b18dde844743d58215f4178220d7e6) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:59.787615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.787929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.788034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.788422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.789732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.790543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.795429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.795429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 84/164] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.801430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.803680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 81/165] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/role_assignments?user.id=38b18dde844743d58215f4178220d7e6&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:16:59.814575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d826b-69ce-4c7a-9561-6ba5b3511d3e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.819411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.820080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.820358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.820633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.829839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.831698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.841746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 85/166] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:16:59.848988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.860111 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1042d-80e8-4abd-8ca6-f939f947bfb8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.864975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d112799-27d7-45c3-92df-951258244116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.865913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112799-27d7-45c3-92df-951258244116 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.866197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112799-27d7-45c3-92df-951258244116 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.866472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112799-27d7-45c3-92df-951258244116 admin admin] PATH_INFO: `/v3/projects/2459305174fb41a1b648a70650c64c30` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.867777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112799-27d7-45c3-92df-951258244116 admin admin] RBAC: Authorizing `identity:get_project(project_id=2459305174fb41a1b648a70650c64c30)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.869993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112799-27d7-45c3-92df-951258244116 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.871934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 82/167] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/projects/2459305174fb41a1b648a70650c64c30 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:16:59.883161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:16:59.894934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba2138-6108-4dbc-8548-e71f281bc85e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:16:59.901563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051753b-5ef5-4ae1-aa67-eeb8ec45fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:16:59.902164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051753b-5ef5-4ae1-aa67-eeb8ec45fab2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:16:59.902446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051753b-5ef5-4ae1-aa67-eeb8ec45fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:16:59.902723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051753b-5ef5-4ae1-aa67-eeb8ec45fab2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:16:59.903653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051753b-5ef5-4ae1-aa67-eeb8ec45fab2 admin admin] RBAC: Adding query filter params (role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=2459305174fb41a1b648a70650c64c30, user.id=bb746cac3a914fd5a9829fbc109253e7) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:16:59.904015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051753b-5ef5-4ae1-aa67-eeb8ec45fab2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:16:59.905944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051753b-5ef5-4ae1-aa67-eeb8ec45fab2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:16:59.916672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 86/168] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:16:59 2021] GET /identity/v3/role_assignments?user.id=bb746cac3a914fd5a9829fbc109253e7&scope.project.id=2459305174fb41a1b648a70650c64c30&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:00.373074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ed13-feec-495d-b562-50ea129fe9b1 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.373619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ed13-feec-495d-b562-50ea129fe9b1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.373619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ed13-feec-495d-b562-50ea129fe9b1 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.375615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 83/169] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:00.385739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dfc46-09ca-4e00-a3d0-29e6986286a1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.386300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dfc46-09ca-4e00-a3d0-29e6986286a1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.386794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dfc46-09ca-4e00-a3d0-29e6986286a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.412772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-126dfc46-09ca-4e00-a3d0-29e6986286a1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:00.414291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-126dfc46-09ca-4e00-a3d0-29e6986286a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:00.424073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 87/170] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:00.452333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34ed13-feec-495d-b562-50ea129fe9b1 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:00.470517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34ed13-feec-495d-b562-50ea129fe9b1 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:00.475556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:00.476585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.477059 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.477546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.492659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:00.499789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:00.501364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 84/171] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:00.509065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dfc46-09ca-4e00-a3d0-29e6986286a1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:00.521386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dfc46-09ca-4e00-a3d0-29e6986286a1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:00.526714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:00.527486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.527775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.528045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.528801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:00.529104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:00.530777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:00.545013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 88/172] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:00.552144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:00.566373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211322f8-2557-47cd-a18d-c60e7bd6d732 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:00.573649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:00.574584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.574866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.575187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.577401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:00.579373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:00.582034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 85/173] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:00 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:00.588473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:00.601031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d9579-e3ef-47c3-a75f-131a720d5e7a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:00.605880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:00.606580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.606864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.607141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.616690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:00.618493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:00.628721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 89/174] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:17:00.635103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:00.646043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14784a-bd39-43fe-a019-fabe46b51c8b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:00.650813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f6957-3cf5-42cf-a517-4b29ac54e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:00.651802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f6957-3cf5-42cf-a517-4b29ac54e4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.652086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f6957-3cf5-42cf-a517-4b29ac54e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.652421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f6957-3cf5-42cf-a517-4b29ac54e4b5 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.653713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f6957-3cf5-42cf-a517-4b29ac54e4b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:00.655970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f6957-3cf5-42cf-a517-4b29ac54e4b5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:00.658566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 86/175] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:00 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:00.666169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:00.678162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d537f-4ccb-4f17-9f60-f03ef76f9f64 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:00.683053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe73f1-6e65-45de-a9e5-b55d76352331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:00.683748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe73f1-6e65-45de-a9e5-b55d76352331 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.684030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe73f1-6e65-45de-a9e5-b55d76352331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.684357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe73f1-6e65-45de-a9e5-b55d76352331 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.685190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe73f1-6e65-45de-a9e5-b55d76352331 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=5f106e34074d41a083ed6d551071767f, user.id=7fef28dc8c914392b02ef34cf0bcbb9c) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:00.685551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe73f1-6e65-45de-a9e5-b55d76352331 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:00.687722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe73f1-6e65-45de-a9e5-b55d76352331 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:00.694785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 90/176] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:00 2021] GET /identity/v3/role_assignments?user.id=7fef28dc8c914392b02ef34cf0bcbb9c&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:00.903823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae733c-68b9-4e85-8599-1f45e9b1a41b None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.904504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae733c-68b9-4e85-8599-1f45e9b1a41b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.905005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae733c-68b9-4e85-8599-1f45e9b1a41b None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.907133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 87/177] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:00.914399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78800-4693-4b73-b6a7-9343b8761367 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.915418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78800-4693-4b73-b6a7-9343b8761367 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.915924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78800-4693-4b73-b6a7-9343b8761367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.936554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-21a78800-4693-4b73-b6a7-9343b8761367 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:00.938118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-21a78800-4693-4b73-b6a7-9343b8761367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:00.946419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 91/178] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:00.970316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae733c-68b9-4e85-8599-1f45e9b1a41b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:00.983106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae733c-68b9-4e85-8599-1f45e9b1a41b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:00.987083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c91ed-671c-461c-906d-80e9512873b7 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.987392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c91ed-671c-461c-906d-80e9512873b7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.987773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c91ed-671c-461c-906d-80e9512873b7 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.989785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 92/179] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:00.991284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:00.992381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.992828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.993251 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.994681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:00.996078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc70ec9-ff55-447a-ba5c-d2f4685272f8 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:00.996439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc70ec9-ff55-447a-ba5c-d2f4685272f8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:00.996789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc70ec9-ff55-447a-ba5c-d2f4685272f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:00.997225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:00.999099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 88/180] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:01.006841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:01.021324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bc207-7d62-4bc8-a8ab-f556ad06ceb1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:01.022994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-5fc70ec9-ff55-447a-ba5c-d2f4685272f8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:01.024219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5fc70ec9-ff55-447a-ba5c-d2f4685272f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:01.026978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:01.028073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:01.028531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:01.028905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] PATH_INFO: `/v3/groups` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:01.029750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:01.030921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:01.030921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:01.030921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:01.032616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:01.033006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 93/181] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:01.056714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 89/182] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Aug 27 03:17:01 2021] POST /identity/v3/groups => generated 229 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:01.068915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc70ec9-ff55-447a-ba5c-d2f4685272f8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:01.079701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc70ec9-ff55-447a-ba5c-d2f4685272f8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:01.085615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:01.086755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:01.087155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:01.087585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:01.100878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:01.108662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:01.110509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 94/183] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:01 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:01.117331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:01.128531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6a5e-eebb-4e07-a75f-b8d5978a554f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:01.133979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:01.135039 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:01.135573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:01.136029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:01.137161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:01.137648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:01.139735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:01.151139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 90/184] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:01 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:01.162122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:01.173306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79f807-7f0e-4bef-8b1a-1fc6af6aaae8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:01.180149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:01.181395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:01.181994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:01.182475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] PATH_INFO: `/v3/users/38b18dde844743d58215f4178220d7e6` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:01.188452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=38b18dde844743d58215f4178220d7e6)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:01.191202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:01.193471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 95/185] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:01 2021] GET /identity/v3/users/38b18dde844743d58215f4178220d7e6 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:01.200770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:01.212299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa97e1-5fee-48cc-845d-8ad6bc9f94bf admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:01.217455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:01.218462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:01.218969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:01.219500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:01.229198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:01.231564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:01.241919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 91/186] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:01.249313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:01.260449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a99be-0eb0-4141-8ade-2d49232614f8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:01.265336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78d227-a648-4380-a7ca-7460f544b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:01.266466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d227-a648-4380-a7ca-7460f544b127 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:01.267120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d227-a648-4380-a7ca-7460f544b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:01.267685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78d227-a648-4380-a7ca-7460f544b127 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:01.269209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78d227-a648-4380-a7ca-7460f544b127 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:01.271604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78d227-a648-4380-a7ca-7460f544b127 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:01.273547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 96/187] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:01 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:01.280195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:01.289535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebec23-41b4-438f-a133-7155fa55845b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:01.294274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf17da-70c4-4d88-b375-d78d933cb772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:01.295141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf17da-70c4-4d88-b375-d78d933cb772 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:01.295705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf17da-70c4-4d88-b375-d78d933cb772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:01.296178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf17da-70c4-4d88-b375-d78d933cb772 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:01.297266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf17da-70c4-4d88-b375-d78d933cb772 admin admin] RBAC: Adding query filter params (role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=5f106e34074d41a083ed6d551071767f, user.id=38b18dde844743d58215f4178220d7e6) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:01.297785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf17da-70c4-4d88-b375-d78d933cb772 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:01.300135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf17da-70c4-4d88-b375-d78d933cb772 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:01.306130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 92/188] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:01 2021] GET /identity/v3/role_assignments?user.id=38b18dde844743d58215f4178220d7e6&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:02.117567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4762b-2a6c-4f7b-9426-3f7484f641b6 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.118121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4762b-2a6c-4f7b-9426-3f7484f641b6 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.118121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4762b-2a6c-4f7b-9426-3f7484f641b6 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.119980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 97/189] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:02.125942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23089c0-bd12-4a15-af06-d478814a2924 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.126404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23089c0-bd12-4a15-af06-d478814a2924 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.126628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23089c0-bd12-4a15-af06-d478814a2924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.144485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b23089c0-bd12-4a15-af06-d478814a2924 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:02.145728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b23089c0-bd12-4a15-af06-d478814a2924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:02.153571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 93/190] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:02.176490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4762b-2a6c-4f7b-9426-3f7484f641b6 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:02.189118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4762b-2a6c-4f7b-9426-3f7484f641b6 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:02.193378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:02.194170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.194443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.194711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.205466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:02.212175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:02.213590 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 98/191] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:02.219791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23089c0-bd12-4a15-af06-d478814a2924 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:02.229075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23089c0-bd12-4a15-af06-d478814a2924 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:02.233525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:02.234198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.234476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.234752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.235665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:02.236107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:02.237749 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:02.246169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 94/192] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:02.252434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:02.261975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce72827-95c9-4ed9-8f16-e1a4d1687d01 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:02.266313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:02.267233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.267551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.267825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] PATH_INFO: `/v3/users/38b18dde844743d58215f4178220d7e6` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.269022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] RBAC: Authorizing `identity:get_user(user_id=38b18dde844743d58215f4178220d7e6)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:02.271142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:02.272968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 99/193] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:02 2021] GET /identity/v3/users/38b18dde844743d58215f4178220d7e6 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:02.278714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:02.288554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f996f0-975c-4891-ad4d-e97c0d98a674 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:02.293017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8de6c-b7e8-49a2-a870-6810c8cc6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:02.293923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8de6c-b7e8-49a2-a870-6810c8cc6ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.294242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8de6c-b7e8-49a2-a870-6810c8cc6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.294512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8de6c-b7e8-49a2-a870-6810c8cc6ee8 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.295829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8de6c-b7e8-49a2-a870-6810c8cc6ee8 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:02.298040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8de6c-b7e8-49a2-a870-6810c8cc6ee8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:02.300100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 95/194] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:02 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:02.306178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:02.318169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb83aef-a04c-45c8-add2-7f1094ff7a09 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:02.323053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26af03a-77fb-4726-8fc2-6e681dff3c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:02.324008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af03a-77fb-4726-8fc2-6e681dff3c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.324332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af03a-77fb-4726-8fc2-6e681dff3c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.324601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af03a-77fb-4726-8fc2-6e681dff3c6c admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f/users/38b18dde844743d58215f4178220d7e6/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.326857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26af03a-77fb-4726-8fc2-6e681dff3c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f106e34074d41a083ed6d551071767f, user_id=38b18dde844743d58215f4178220d7e6, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:02.329821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26af03a-77fb-4726-8fc2-6e681dff3c6c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:02.344899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 100/195] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:02 2021] PUT /identity/v3/projects/5f106e34074d41a083ed6d551071767f/users/38b18dde844743d58215f4178220d7e6/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:17:02.977356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d2321-286d-441c-8450-852189c8f70a None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.977744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d2321-286d-441c-8450-852189c8f70a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.977946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d2321-286d-441c-8450-852189c8f70a None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:02.979725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 96/196] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:02.985948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4cd5-78ab-4470-b98d-5b9e9092969c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:02.986304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4cd5-78ab-4470-b98d-5b9e9092969c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:02.986705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4cd5-78ab-4470-b98d-5b9e9092969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.004710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1cbf4cd5-78ab-4470-b98d-5b9e9092969c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:03.005892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1cbf4cd5-78ab-4470-b98d-5b9e9092969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:03.064568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 101/197] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:03.087915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d2321-286d-441c-8450-852189c8f70a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.100541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d2321-286d-441c-8450-852189c8f70a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.105029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.105818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.106094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.106414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.117075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:03.123695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:03.125131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 97/198] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:03.131665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf4cd5-78ab-4470-b98d-5b9e9092969c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.140910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf4cd5-78ab-4470-b98d-5b9e9092969c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.146028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.146754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.147030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.147295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.148081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:03.148379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.150104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.159380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 102/199] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:03.165633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.176288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33865f0c-c327-4d9e-81b0-b62e88c260ed admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.180683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.181556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.181833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.182102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.183702 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.185526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.187132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 98/200] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:03.193470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.203592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e649c-1a59-4869-b85e-1338f5915862 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.208934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c9af-20ed-42b6-8a4c-18fe8d1dc3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.209806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c9af-20ed-42b6-8a4c-18fe8d1dc3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.210088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c9af-20ed-42b6-8a4c-18fe8d1dc3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.210369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c9af-20ed-42b6-8a4c-18fe8d1dc3d2 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.211660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7c9af-20ed-42b6-8a4c-18fe8d1dc3d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.213771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7c9af-20ed-42b6-8a4c-18fe8d1dc3d2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.215772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 103/201] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:03.222757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.232920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101411d-c752-4e23-8bb5-43be08ba30ae admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.238166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf3742-59d4-4b93-a1dc-dbe335e149d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.239159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3742-59d4-4b93-a1dc-dbe335e149d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.239473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3742-59d4-4b93-a1dc-dbe335e149d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.239798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3742-59d4-4b93-a1dc-dbe335e149d2 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f/users/7fef28dc8c914392b02ef34cf0bcbb9c/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.241793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf3742-59d4-4b93-a1dc-dbe335e149d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f106e34074d41a083ed6d551071767f, user_id=7fef28dc8c914392b02ef34cf0bcbb9c, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.244661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf3742-59d4-4b93-a1dc-dbe335e149d2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.260320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 99/202] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:03 2021] PUT /identity/v3/projects/5f106e34074d41a083ed6d551071767f/users/7fef28dc8c914392b02ef34cf0bcbb9c/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:03.348527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300287-13d6-4f7a-8ae6-728f89a77e59 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.349230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300287-13d6-4f7a-8ae6-728f89a77e59 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.349823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c300287-13d6-4f7a-8ae6-728f89a77e59 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.352081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 104/203] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:03.359147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04227-47b5-4701-bf0d-dbe901f061dd None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.359790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04227-47b5-4701-bf0d-dbe901f061dd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.360296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa04227-47b5-4701-bf0d-dbe901f061dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.380314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-4aa04227-47b5-4701-bf0d-dbe901f061dd None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:03.382036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4aa04227-47b5-4701-bf0d-dbe901f061dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:03.450553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 100/204] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:03.464543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45032-42ac-4d73-92dc-e3126d726a58 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.464865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45032-42ac-4d73-92dc-e3126d726a58 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.465102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45032-42ac-4d73-92dc-e3126d726a58 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.467247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 105/205] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:03.472968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018941a-d0ba-4c2f-a671-d7d9b6450229 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.473258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018941a-d0ba-4c2f-a671-d7d9b6450229 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.473541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018941a-d0ba-4c2f-a671-d7d9b6450229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.480744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45032-42ac-4d73-92dc-e3126d726a58 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.494287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45032-42ac-4d73-92dc-e3126d726a58 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.499634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5018941a-d0ba-4c2f-a671-d7d9b6450229 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:03.500814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5018941a-d0ba-4c2f-a671-d7d9b6450229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:03.501065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.502307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.502604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.502888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.504150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.505849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.508473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 106/206] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:03.509608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 101/207] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:03.515073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.526097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d0c74-d9cd-4f0b-86a6-e2fe23ade650 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.530922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.531602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.531937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.532049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018941a-d0ba-4c2f-a671-d7d9b6450229 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.532311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] PATH_INFO: `/v3/groups` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.533120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.534379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:03.534379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:03.534379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:03.535747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.541774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018941a-d0ba-4c2f-a671-d7d9b6450229 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.548869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.549829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.550110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.550523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.554414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 107/208] 10.222.0.58 () {60 vars in 1156 bytes} [Fri Aug 27 03:17:03 2021] POST /identity/v3/groups => generated 226 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:03.566808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:03.574908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:03.576524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 102/209] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:03.583547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.594306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fec1-0443-4aa6-a037-089d46c0d6bc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.601505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.602194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.602472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.602741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.603671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:03.603972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.605717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.616302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 108/210] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:03.622734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.633539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6025d95-8e95-4de6-96a4-6c5ced3cd847 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.638408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.639559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.639952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.640217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] PATH_INFO: `/v3/users/38b18dde844743d58215f4178220d7e6` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.642464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=38b18dde844743d58215f4178220d7e6)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.644729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.646679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 103/211] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/users/38b18dde844743d58215f4178220d7e6 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:03.653091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.663959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941fc5e-1764-4dbb-8900-b6f5af8cbd91 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.668749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b958b-97fb-4d4f-a94c-3a47adaf8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.669682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b958b-97fb-4d4f-a94c-3a47adaf8c92 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.670014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b958b-97fb-4d4f-a94c-3a47adaf8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.670335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b958b-97fb-4d4f-a94c-3a47adaf8c92 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.671681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b958b-97fb-4d4f-a94c-3a47adaf8c92 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.674036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b958b-97fb-4d4f-a94c-3a47adaf8c92 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.676183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 109/212] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:03 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:03.682641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:03.694798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e097941-2438-4758-9acd-1ec90837a5f0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:03.699679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d70f1-bda4-4bdc-9826-fee9872ae413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:03.700639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d70f1-bda4-4bdc-9826-fee9872ae413 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:03.700914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d70f1-bda4-4bdc-9826-fee9872ae413 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:03.701182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d70f1-bda4-4bdc-9826-fee9872ae413 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f/users/38b18dde844743d58215f4178220d7e6/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:03.703575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d70f1-bda4-4bdc-9826-fee9872ae413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f106e34074d41a083ed6d551071767f, user_id=38b18dde844743d58215f4178220d7e6, role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:03.706639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d70f1-bda4-4bdc-9826-fee9872ae413 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:03.724787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 104/213] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:03 2021] PUT /identity/v3/projects/5f106e34074d41a083ed6d551071767f/users/38b18dde844743d58215f4178220d7e6/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:04.580838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f345-dc05-4033-9ec4-9e742ba2229d None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.581375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f345-dc05-4033-9ec4-9e742ba2229d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.581375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f345-dc05-4033-9ec4-9e742ba2229d None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.583299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 110/214] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:04.589529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6579a8-c509-4f4b-839e-660854467e06 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.590423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6579a8-c509-4f4b-839e-660854467e06 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.590891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6579a8-c509-4f4b-839e-660854467e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.609758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3f6579a8-c509-4f4b-839e-660854467e06 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:04.611735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3f6579a8-c509-4f4b-839e-660854467e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:04.672695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 105/215] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:04.698025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641f345-dc05-4033-9ec4-9e742ba2229d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:04.710666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641f345-dc05-4033-9ec4-9e742ba2229d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:04.715001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:04.715906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.716181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.716448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.731691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:04.738726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:04.739967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 111/216] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:04.746293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6579a8-c509-4f4b-839e-660854467e06 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:04.755718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6579a8-c509-4f4b-839e-660854467e06 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:04.763376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:04.764033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.764307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.764575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.765333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:04.765631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:04.767723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:04.776441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 106/217] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:04.782938 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:04.794294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f6be8-6dfc-49be-a07c-1585fa94093c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:04.800417 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:04.801352 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.801625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.801984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] PATH_INFO: `/v3/users/38b18dde844743d58215f4178220d7e6` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.803254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=38b18dde844743d58215f4178220d7e6)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:04.805490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:04.807209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 112/218] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:04 2021] GET /identity/v3/users/38b18dde844743d58215f4178220d7e6 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:04.814553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:04.827116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fccc1-415c-478e-96cd-f6a2d6525f13 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:04.832680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:04.833390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.833664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.833982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.842878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:04.844893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:04.854248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 107/219] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:04.860663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:04.871136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b020fc-261d-4120-bb25-32414f8730a2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:04.875670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903d443-cb1b-4445-8ac1-289b0f90df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:04.876926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903d443-cb1b-4445-8ac1-289b0f90df84 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.877151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903d443-cb1b-4445-8ac1-289b0f90df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.877424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903d443-cb1b-4445-8ac1-289b0f90df84 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.878665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903d443-cb1b-4445-8ac1-289b0f90df84 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:04.880727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903d443-cb1b-4445-8ac1-289b0f90df84 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:04.882450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 113/220] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:04 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:04.888975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:04.898436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1b3e9-62a9-4a0c-bc6a-a8e54fe0a788 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:04.902891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dade1c-f334-4850-a12e-dca365d1cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:04.903628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dade1c-f334-4850-a12e-dca365d1cc9c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:04.903906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dade1c-f334-4850-a12e-dca365d1cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:04.904177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dade1c-f334-4850-a12e-dca365d1cc9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:04.905004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dade1c-f334-4850-a12e-dca365d1cc9c admin admin] RBAC: Adding query filter params (role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=5f106e34074d41a083ed6d551071767f, user.id=38b18dde844743d58215f4178220d7e6) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:04.907663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dade1c-f334-4850-a12e-dca365d1cc9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:04.909590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dade1c-f334-4850-a12e-dca365d1cc9c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:04.916110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 108/221] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:04 2021] GET /identity/v3/role_assignments?user.id=38b18dde844743d58215f4178220d7e6&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:05.757961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41949b3-0ba9-4917-97a3-5b6f4cd89f44 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:05.758651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41949b3-0ba9-4917-97a3-5b6f4cd89f44 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:05.758651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41949b3-0ba9-4917-97a3-5b6f4cd89f44 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:05.760573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 114/222] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:05.767410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3f212-8793-4d3a-96a0-0e57a5eab3fd None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:05.768054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3f212-8793-4d3a-96a0-0e57a5eab3fd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:05.768054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3f212-8793-4d3a-96a0-0e57a5eab3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:05.788347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1cd3f212-8793-4d3a-96a0-0e57a5eab3fd None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:05.789558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1cd3f212-8793-4d3a-96a0-0e57a5eab3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:05.797693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 109/223] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:05.833862 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41949b3-0ba9-4917-97a3-5b6f4cd89f44 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:05.846529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41949b3-0ba9-4917-97a3-5b6f4cd89f44 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:05.855337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:05.856158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:05.856436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:05.856708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:05.867873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:05.874502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:05.875746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 115/224] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:05.883338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3f212-8793-4d3a-96a0-0e57a5eab3fd None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:05.892802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3f212-8793-4d3a-96a0-0e57a5eab3fd None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:05.899288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:05.899991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:05.900269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:05.900542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:05.901299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:05.901602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:05.903228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:05.912975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 110/225] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:05.919290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:05.930607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84930e4-2800-4651-862a-1e6fa318eb1e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:05.935761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:05.936641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:05.936915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:05.937187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:05.939853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:05.941734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:05.943397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 116/226] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:05 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:05.950247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:05.960645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0c81b-5556-412d-abcd-8483fa29e54a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:05.967607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:05.968319 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:05.968598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:05.968912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:05.978083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:05.979926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:05.989788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 111/227] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:05.996059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.006793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de47fd-e9ec-423d-ad9a-8dbd3ac6e65e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.015520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15d2ea-5d35-402c-a877-1a901400146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.016332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15d2ea-5d35-402c-a877-1a901400146e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.016646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15d2ea-5d35-402c-a877-1a901400146e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.016922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15d2ea-5d35-402c-a877-1a901400146e admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.018139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15d2ea-5d35-402c-a877-1a901400146e admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.020286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15d2ea-5d35-402c-a877-1a901400146e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.021986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 117/228] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:05 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.029549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.038925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58802008-e473-4402-88bd-9765236f4a44 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.046798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33224f-e4d9-4e3b-bfcb-390868bfc4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.047487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33224f-e4d9-4e3b-bfcb-390868bfc4ae admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.047883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33224f-e4d9-4e3b-bfcb-390868bfc4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.048158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33224f-e4d9-4e3b-bfcb-390868bfc4ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.049049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33224f-e4d9-4e3b-bfcb-390868bfc4ae admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=5f106e34074d41a083ed6d551071767f, user.id=7fef28dc8c914392b02ef34cf0bcbb9c) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:06.049356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33224f-e4d9-4e3b-bfcb-390868bfc4ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.051270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33224f-e4d9-4e3b-bfcb-390868bfc4ae admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.058271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 112/229] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/role_assignments?user.id=7fef28dc8c914392b02ef34cf0bcbb9c&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.536722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8a368-4ea8-4883-8155-d266dfce6cfa None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.537090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8a368-4ea8-4883-8155-d266dfce6cfa None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.537280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8a368-4ea8-4883-8155-d266dfce6cfa None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.539299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 118/230] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:06.546182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90cf8-1989-4f93-9816-7872d9336bf1 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.546498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90cf8-1989-4f93-9816-7872d9336bf1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.546850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90cf8-1989-4f93-9816-7872d9336bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.566213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-67f90cf8-1989-4f93-9816-7872d9336bf1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:06.567410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-67f90cf8-1989-4f93-9816-7872d9336bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:06.577700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 113/231] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:06.592411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27a076-cf9e-4e1b-98e4-c33aa103d1ff None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.592679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27a076-cf9e-4e1b-98e4-c33aa103d1ff None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.592952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27a076-cf9e-4e1b-98e4-c33aa103d1ff None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.594753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 119/232] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:06.601257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cfe4e-a2d9-4d17-b392-7efa445d265d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.601539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cfe4e-a2d9-4d17-b392-7efa445d265d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.601813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cfe4e-a2d9-4d17-b392-7efa445d265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.607436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27a076-cf9e-4e1b-98e4-c33aa103d1ff None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.621549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-645cfe4e-a2d9-4d17-b392-7efa445d265d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:06.622725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-645cfe4e-a2d9-4d17-b392-7efa445d265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:06.630171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27a076-cf9e-4e1b-98e4-c33aa103d1ff None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.637844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.638648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.638923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.639193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.641652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 114/233] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:06.656682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:06.663530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:06.664925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 120/234] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:06.671470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cfe4e-a2d9-4d17-b392-7efa445d265d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.681382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cfe4e-a2d9-4d17-b392-7efa445d265d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.688918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.691774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.692460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.692789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.693064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.693871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:06.694179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.695828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.698906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b2ee-f462-4d04-a7a0-72329ea37754 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.711680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 115/235] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.718086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.718344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.719011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.719289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.719582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.732660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652c8f-7a51-465f-b2fe-9cddac385f8e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.738457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.739156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.739461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.739733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.740410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:06.749343 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.751282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.751860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:06.753434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 121/236] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:06.765348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 116/237] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:17:06.770142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.772603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.781835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc39721-f029-434c-9342-cd6b37a60397 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.784348 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b4f7-130d-4a66-af4b-c071af2f3035 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.796116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.796436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.796806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.797041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.797204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.797359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.797502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.797641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.798405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:06.798719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.800361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.800556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.802731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.804575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 117/238] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.810120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 122/239] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.811301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.823176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad39ef-a6b4-477f-8213-64ec63edad25 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.828738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.833813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.834695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.835016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.835288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.841224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510fae5-e3ec-4979-8255-594064a101fe admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.852140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.852426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.853070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.853239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:06.853239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:06.853239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:06.853628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.853628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] PATH_INFO: `/v3/users/38b18dde844743d58215f4178220d7e6` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.854619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.854834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=38b18dde844743d58215f4178220d7e6)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.856799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 118/240] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.856984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.858836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 123/241] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/users/38b18dde844743d58215f4178220d7e6 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.863934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.874209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279edc5-f1b9-4451-939b-d7eaeb8b3cb9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.877978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.880626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.881344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.881620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.881939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.882836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:06.883151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.885179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.889113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d22e7e-d0f5-42ff-a7d9-264e39890bf2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.893525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 119/242] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.905738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.906410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.906731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.906946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.917862 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.919813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.934772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 124/243] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:06.941991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.952698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002291b-4f35-40bd-8efc-e1af1a21b712 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.958496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3531d9-f802-4eab-b45d-888f24ace1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.959780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3531d9-f802-4eab-b45d-888f24ace1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.960223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3531d9-f802-4eab-b45d-888f24ace1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.960681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3531d9-f802-4eab-b45d-888f24ace1f5 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.962114 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3531d9-f802-4eab-b45d-888f24ace1f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.964536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3531d9-f802-4eab-b45d-888f24ace1f5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:06.966804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 120/244] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:06.973695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:06.987917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a8b71-7532-468e-a78d-178b3dbdd480 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:06.995647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6392c-7199-4790-adff-67eec2240611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:06.996319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6392c-7199-4790-adff-67eec2240611 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:06.996598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6392c-7199-4790-adff-67eec2240611 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:06.996867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6392c-7199-4790-adff-67eec2240611 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:06.997712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6392c-7199-4790-adff-67eec2240611 admin admin] RBAC: Adding query filter params (role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=5f106e34074d41a083ed6d551071767f, user.id=38b18dde844743d58215f4178220d7e6) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:06.998020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6392c-7199-4790-adff-67eec2240611 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:06.999916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6392c-7199-4790-adff-67eec2240611 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:07.012785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 125/245] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:06 2021] GET /identity/v3/role_assignments?user.id=38b18dde844743d58215f4178220d7e6&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:07.697419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db694e66-f4fe-4cff-b76d-69e8abe25fe1 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:07.698104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db694e66-f4fe-4cff-b76d-69e8abe25fe1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:07.698579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db694e66-f4fe-4cff-b76d-69e8abe25fe1 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:07.700859 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 121/246] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:07.706817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf8cb8-d3f6-42ad-93c7-4f8803367c23 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:07.707103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf8cb8-d3f6-42ad-93c7-4f8803367c23 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:07.707396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf8cb8-d3f6-42ad-93c7-4f8803367c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:07.728321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7ebf8cb8-d3f6-42ad-93c7-4f8803367c23 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:07.729516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7ebf8cb8-d3f6-42ad-93c7-4f8803367c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:07.737223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 126/247] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:07.775020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db694e66-f4fe-4cff-b76d-69e8abe25fe1 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:07.796162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db694e66-f4fe-4cff-b76d-69e8abe25fe1 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:07.801120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:07.802185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:07.802653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:07.803108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:07.820867 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:07.828410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:07.829889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 122/248] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:07.836419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf8cb8-d3f6-42ad-93c7-4f8803367c23 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:07.850115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf8cb8-d3f6-42ad-93c7-4f8803367c23 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:07.857474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:07.858148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:07.858424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:07.858692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:07.859483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:07.859785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:07.861433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:07.876603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 127/249] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:07.882721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:07.893211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ed2f0-1a96-4dee-83a1-2824e3af17ea admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:07.901704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:07.902650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:07.903188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:07.903664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:07.918912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:07.921139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:07.931552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 123/250] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:07.938743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:07.956600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb376-2513-4922-8062-7d1d10bbe976 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:07.968575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:07.969450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:07.969839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:07.970230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:07.971994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:07.974047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:07.976075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 128/251] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:07 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:07.982298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:07.992169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d54a5-937a-475e-b44f-4abaea3ec7b4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.002397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89550591-b95a-4523-af34-596c731d2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.003649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550591-b95a-4523-af34-596c731d2c55 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.004121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550591-b95a-4523-af34-596c731d2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.004635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89550591-b95a-4523-af34-596c731d2c55 admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.006017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89550591-b95a-4523-af34-596c731d2c55 admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.008157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89550591-b95a-4523-af34-596c731d2c55 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.010061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 124/252] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:07 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:08.016845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.032381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab2674-37f1-4c72-967f-f7eff4e763ce admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.044490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f7253-336c-4184-afcb-b2e892b75c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.045158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f7253-336c-4184-afcb-b2e892b75c54 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.045434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f7253-336c-4184-afcb-b2e892b75c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.045705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f7253-336c-4184-afcb-b2e892b75c54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.046594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f7253-336c-4184-afcb-b2e892b75c54 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:08.046908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f7253-336c-4184-afcb-b2e892b75c54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.048890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f7253-336c-4184-afcb-b2e892b75c54 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.056915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 129/253] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:08.293774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d35f01-70f8-484e-afc3-d23f5fe21142 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.294422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d35f01-70f8-484e-afc3-d23f5fe21142 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.294959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d35f01-70f8-484e-afc3-d23f5fe21142 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.297029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 125/254] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:08.304178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f1447-74d4-4de0-bee9-f961fd921c45 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.304776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f1447-74d4-4de0-bee9-f961fd921c45 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.305267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f1447-74d4-4de0-bee9-f961fd921c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.325523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1c9f1447-74d4-4de0-bee9-f961fd921c45 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:08.327037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1c9f1447-74d4-4de0-bee9-f961fd921c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:08.340044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 130/255] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:08.364978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d35f01-70f8-484e-afc3-d23f5fe21142 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.385298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d35f01-70f8-484e-afc3-d23f5fe21142 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.390878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.392033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.392514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.392974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.410221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:08.417062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:08.418587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 126/256] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:08.425270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f1447-74d4-4de0-bee9-f961fd921c45 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.441077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f1447-74d4-4de0-bee9-f961fd921c45 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.449854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.450542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.450823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.451095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.451892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:08.452196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.453785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.466897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 131/257] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:08.473335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.489311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2155f-92ac-4114-9d89-a23f3959bcc2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.499972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.500639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.501030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.501437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.510385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.512203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.524322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 127/258] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:08.535100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.548472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4266a59-8f8a-42ae-90e2-15ca106b7001 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.555552 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.556436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.556711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.556982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.558666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.561135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.564018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 132/259] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:08.570311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.585974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a93ed-a243-425d-a02d-7ddb2610174a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.600260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656441bb-b2b6-4f34-b1e4-885b908a136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.601192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656441bb-b2b6-4f34-b1e4-885b908a136c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.601447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656441bb-b2b6-4f34-b1e4-885b908a136c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.601723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656441bb-b2b6-4f34-b1e4-885b908a136c admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.603080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656441bb-b2b6-4f34-b1e4-885b908a136c admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.605103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656441bb-b2b6-4f34-b1e4-885b908a136c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.606821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 128/260] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:08.614203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.629266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16fe55-8514-4397-84c8-88bbd313e7d6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.639678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13227fa-7524-47e2-beb6-1e631d85b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.640360 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13227fa-7524-47e2-beb6-1e631d85b434 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.640642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13227fa-7524-47e2-beb6-1e631d85b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.640916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13227fa-7524-47e2-beb6-1e631d85b434 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.641945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13227fa-7524-47e2-beb6-1e631d85b434 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=5f106e34074d41a083ed6d551071767f) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:08.642147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13227fa-7524-47e2-beb6-1e631d85b434 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.644061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13227fa-7524-47e2-beb6-1e631d85b434 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.655052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 133/261] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:08.699713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95866f-6f4c-4026-ba22-a1e2677c1e09 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.700023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95866f-6f4c-4026-ba22-a1e2677c1e09 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.700256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95866f-6f4c-4026-ba22-a1e2677c1e09 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.702383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 129/262] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:08.708762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907377-4a9f-4776-bddf-a5f6f065a2eb None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.709069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907377-4a9f-4776-bddf-a5f6f065a2eb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.709306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37907377-4a9f-4776-bddf-a5f6f065a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.861298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-37907377-4a9f-4776-bddf-a5f6f065a2eb None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:08.861298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-37907377-4a9f-4776-bddf-a5f6f065a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:08.873827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 134/263] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:08.902036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95866f-6f4c-4026-ba22-a1e2677c1e09 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.916657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95866f-6f4c-4026-ba22-a1e2677c1e09 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.921686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.922931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.923720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.924372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.937448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:08.945268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:08.946976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 130/264] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:08.953655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37907377-4a9f-4776-bddf-a5f6f065a2eb None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:08.963531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37907377-4a9f-4776-bddf-a5f6f065a2eb None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:08.968294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:08.969235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:08.969785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:08.970296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:08.971505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:08.972002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:08.973883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:08.983311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 135/265] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:08.990133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.000396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7d042-8762-4841-9110-b4e7de0096d1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.005905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.006923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.007537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.008106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.017938 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.020107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.029847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 131/266] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:09.036994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.047178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff138823-d7b5-4e68-9ebb-d97b3f4b204f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.051870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.052958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.053468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.054047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.055446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.057738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.062355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 136/267] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:09.070447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.080742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc0964-e985-478b-8a68-ecf4d5da8fa4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.085542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57b736-8daa-4c74-8c66-93af275530c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.086627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b736-8daa-4c74-8c66-93af275530c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.087099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b736-8daa-4c74-8c66-93af275530c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.087619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b736-8daa-4c74-8c66-93af275530c3 admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.089041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57b736-8daa-4c74-8c66-93af275530c3 admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.091126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57b736-8daa-4c74-8c66-93af275530c3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.093389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 132/268] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:09.100102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.113223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954007cd-7a67-47cd-bdac-b5b4c73f6e3f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.122973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9cbe5-53aa-4534-bd66-d166e862e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.123665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9cbe5-53aa-4534-bd66-d166e862e838 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.123953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9cbe5-53aa-4534-bd66-d166e862e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.124229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9cbe5-53aa-4534-bd66-d166e862e838 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.125069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9cbe5-53aa-4534-bd66-d166e862e838 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=5f106e34074d41a083ed6d551071767f) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:09.125385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9cbe5-53aa-4534-bd66-d166e862e838 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.127826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9cbe5-53aa-4534-bd66-d166e862e838 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.139759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 137/269] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:09.583443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837cd7a-9eb3-4474-9a69-0cfd09968f50 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.584128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837cd7a-9eb3-4474-9a69-0cfd09968f50 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.584604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837cd7a-9eb3-4474-9a69-0cfd09968f50 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.586579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 133/270] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:09.594095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e4f45-9cbb-4940-8fe0-46d661904f72 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.594384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e4f45-9cbb-4940-8fe0-46d661904f72 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.594711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e4f45-9cbb-4940-8fe0-46d661904f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.619115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e60e4f45-9cbb-4940-8fe0-46d661904f72 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:09.620347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e60e4f45-9cbb-4940-8fe0-46d661904f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:09.634923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 138/271] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:09.678638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837cd7a-9eb3-4474-9a69-0cfd09968f50 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.696386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837cd7a-9eb3-4474-9a69-0cfd09968f50 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.707102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4bc8e-40bd-4790-8071-8c21427affb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.708261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bc8e-40bd-4790-8071-8c21427affb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.708731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bc8e-40bd-4790-8071-8c21427affb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.709637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4bc8e-40bd-4790-8071-8c21427affb8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.723180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4bc8e-40bd-4790-8071-8c21427affb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:09.730660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-ceb4bc8e-40bd-4790-8071-8c21427affb8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:09.732162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 134/272] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:09.739152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e4f45-9cbb-4940-8fe0-46d661904f72 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.746754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd950-809b-47ba-b4ec-ac6f96654e83 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.747034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd950-809b-47ba-b4ec-ac6f96654e83 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.747310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd950-809b-47ba-b4ec-ac6f96654e83 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.749841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 135/273] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:09.753050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e4f45-9cbb-4940-8fe0-46d661904f72 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.760929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015a4c7-a74e-404d-a0ad-3d246fe6c5cc None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.761588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015a4c7-a74e-404d-a0ad-3d246fe6c5cc None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.762001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015a4c7-a74e-404d-a0ad-3d246fe6c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.762732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.763531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.763882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.764207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.765027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:09.765393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.767120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.785227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 139/274] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:09.792896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2015a4c7-a74e-404d-a0ad-3d246fe6c5cc None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:09.794304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2015a4c7-a74e-404d-a0ad-3d246fe6c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:09.803791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 136/275] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:09.805385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.816348 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2591d01-5f31-4244-b580-2efdd92b25d8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.821858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.822752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.823226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.823682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.831876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015a4c7-a74e-404d-a0ad-3d246fe6c5cc None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.844477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015a4c7-a74e-404d-a0ad-3d246fe6c5cc None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.852569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.853393 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.853676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.853962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.854522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.856653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.866669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 140/276] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:17:09.873738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.882561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:09.883764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d227407-0cc6-41b2-ab40-bccaae44cb3e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.889367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:09.890569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 137/277] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:09.893690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.894827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.895312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.895776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] PATH_INFO: `/v3/projects/dd18f6074b9647bca69baffc389eb123` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.897181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd18f6074b9647bca69baffc389eb123)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.897286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.899474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.901419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 141/278] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/projects/dd18f6074b9647bca69baffc389eb123 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:09.907693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.917129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526efb5-46bc-424d-9443-6914b00d44cb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.928958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daec18-80d8-4fc2-9a96-5e5938cde640 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.929333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.930199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.931331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.931839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.933484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:09.935240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.939315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.940495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.941898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.943200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.943874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] PATH_INFO: `/v3/groups/580d3a2579f448b6b667a42a40bcfb03` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.956504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] RBAC: Authorizing `identity:get_group(group_id=580d3a2579f448b6b667a42a40bcfb03)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.959394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:09.959394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:09.959394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:09.960194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 138/279] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:09.961559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.963535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 142/280] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/groups/580d3a2579f448b6b667a42a40bcfb03 => generated 229 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:09.966593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.978921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3cedc-1fe2-46e4-acf0-d349394fce4d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.982737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:09.986323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:09.987490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:09.988210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:09.988650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:09.990060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:09.993093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:09.994784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d201150-fe00-4616-b0b9-5aab414e12a5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:09.995066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 139/281] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:10.001192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:10.012730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754df7d-1d4d-4af4-ad29-1e0cd29b805e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:10.019371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:10.019371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:10.019371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:10.019371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:10.019710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] RBAC: Adding query filter params (group.id=580d3a2579f448b6b667a42a40bcfb03, role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=dd18f6074b9647bca69baffc389eb123) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:10.019710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:10.019710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:10.025860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 143/282] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:09 2021] GET /identity/v3/role_assignments?group.id=580d3a2579f448b6b667a42a40bcfb03&scope.project.id=dd18f6074b9647bca69baffc389eb123&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:10.027614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e297f9-5403-44f0-a5b8-c8f1b4aab04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:10.028665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e297f9-5403-44f0-a5b8-c8f1b4aab04d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:10.029093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e297f9-5403-44f0-a5b8-c8f1b4aab04d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:10.029502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e297f9-5403-44f0-a5b8-c8f1b4aab04d admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:10.036401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e297f9-5403-44f0-a5b8-c8f1b4aab04d admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:10.038740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e297f9-5403-44f0-a5b8-c8f1b4aab04d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:10.040791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 140/283] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:10 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:10.048110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:10.063728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5584c34-162d-44d7-bcc6-f25dda7054a1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:10.077837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c0c1c-8f59-4801-b8af-500491d81855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:10.079059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0c1c-8f59-4801-b8af-500491d81855 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:10.079539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0c1c-8f59-4801-b8af-500491d81855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:10.079995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0c1c-8f59-4801-b8af-500491d81855 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/groups/72428833c1c548f79d1162ff6be5ce74/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:10.084861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c0c1c-8f59-4801-b8af-500491d81855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb3a0e4cb1d4b259b17107aefbb397b, group_id=72428833c1c548f79d1162ff6be5ce74, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:10.087575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c0c1c-8f59-4801-b8af-500491d81855 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:10.110915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 144/284] 10.222.0.58 () {58 vars in 1464 bytes} [Fri Aug 27 03:17:10 2021] PUT /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/groups/72428833c1c548f79d1162ff6be5ce74/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:11.120504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5a21-6318-457a-963b-4180fe8ac511 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.121517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5a21-6318-457a-963b-4180fe8ac511 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.122007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5a21-6318-457a-963b-4180fe8ac511 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.124011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 141/285] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:11.133649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c478-6438-4752-bc7a-d5681ed4a614 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.134162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c478-6438-4752-bc7a-d5681ed4a614 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.134236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24c478-6438-4752-bc7a-d5681ed4a614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.157383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ea24c478-6438-4752-bc7a-d5681ed4a614 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:11.158763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ea24c478-6438-4752-bc7a-d5681ed4a614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:11.237218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 145/286] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:11.284853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5a21-6318-457a-963b-4180fe8ac511 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.301401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5a21-6318-457a-963b-4180fe8ac511 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.308772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.309588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.309869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.310142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.321232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:11.328375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:11.329891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 142/287] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:11.336623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24c478-6438-4752-bc7a-d5681ed4a614 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.346125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24c478-6438-4752-bc7a-d5681ed4a614 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.352148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.352828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.353109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.353381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.354147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:11.354451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.356089 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.370963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 146/288] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:11.377887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.393396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4322f29-c22f-4aff-a4d2-7d7964ad1d71 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.403247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.404149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.404427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.404698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.405871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.407879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.409520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 143/289] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:11.415928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.428644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66399e8-3078-47fb-bdb0-35a12e848e99 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.439337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633034a-ef33-4620-a350-2aba4a58ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.440246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633034a-ef33-4620-a350-2aba4a58ca30 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.440526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633034a-ef33-4620-a350-2aba4a58ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.440802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633034a-ef33-4620-a350-2aba4a58ca30 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.442189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633034a-ef33-4620-a350-2aba4a58ca30 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.444341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633034a-ef33-4620-a350-2aba4a58ca30 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.446121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 147/290] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:11.452906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.469247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05203-acdb-4acd-958c-f9ca6be42c95 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.477102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce38801-082c-4b13-8879-a92d6d4bd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.478025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38801-082c-4b13-8879-a92d6d4bd333 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.478335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38801-082c-4b13-8879-a92d6d4bd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.478582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38801-082c-4b13-8879-a92d6d4bd333 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/groups/72428833c1c548f79d1162ff6be5ce74/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.481138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce38801-082c-4b13-8879-a92d6d4bd333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb3a0e4cb1d4b259b17107aefbb397b, group_id=72428833c1c548f79d1162ff6be5ce74, role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.483908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce38801-082c-4b13-8879-a92d6d4bd333 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.508160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 144/291] 10.222.0.58 () {58 vars in 1464 bytes} [Fri Aug 27 03:17:11 2021] PUT /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b/groups/72428833c1c548f79d1162ff6be5ce74/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:11.560210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd008-3cf7-46f4-b95d-96542b9a80d3 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.560562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd008-3cf7-46f4-b95d-96542b9a80d3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.560768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcd008-3cf7-46f4-b95d-96542b9a80d3 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.562986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 148/292] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:11.570991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd56ef-4efd-4dc0-a59f-ae7cba132040 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.571268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd56ef-4efd-4dc0-a59f-ae7cba132040 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.571566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd56ef-4efd-4dc0-a59f-ae7cba132040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.593960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c5cd56ef-4efd-4dc0-a59f-ae7cba132040 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:11.595923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c5cd56ef-4efd-4dc0-a59f-ae7cba132040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:11.665800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 145/293] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:11.707564 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd008-3cf7-46f4-b95d-96542b9a80d3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.730746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcd008-3cf7-46f4-b95d-96542b9a80d3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.735581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.736430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.736751 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.737029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.760719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:11.768477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:11.769957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 149/294] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:11.776957 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd56ef-4efd-4dc0-a59f-ae7cba132040 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.793174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd56ef-4efd-4dc0-a59f-ae7cba132040 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.802417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.803181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.803536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.803817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.804596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:11.804905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.806643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.823239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 146/295] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:11.829966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.845197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbe77c-cf1b-42cb-8f0f-00a1d1ac5f88 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.853384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.854269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.854548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.854820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.860369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.862563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.864365 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 150/296] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:11.870943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.884621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7af90c-62cf-435f-a7f1-1eeaa8cbac38 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.893055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2c4e1-17b4-4a84-bd2f-5053610f3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.893933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c4e1-17b4-4a84-bd2f-5053610f3580 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.894262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c4e1-17b4-4a84-bd2f-5053610f3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.894538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c4e1-17b4-4a84-bd2f-5053610f3580 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.897552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2c4e1-17b4-4a84-bd2f-5053610f3580 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.899888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2c4e1-17b4-4a84-bd2f-5053610f3580 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.902036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 147/297] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:11 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:11.908864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:11.909942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab880c-4b9e-4084-9827-f8b9012d200d None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.910233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab880c-4b9e-4084-9827-f8b9012d200d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.910513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab880c-4b9e-4084-9827-f8b9012d200d None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.912401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 148/298] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:11.919764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac98a5-3efc-4061-a672-a23bef416a4b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.920235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac98a5-3efc-4061-a672-a23bef416a4b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.920700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac98a5-3efc-4061-a672-a23bef416a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.921212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542de3c7-9abf-49c9-b85f-8fa784c999b7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:11.928896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:11.929458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:11.929740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:11.930018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f/groups/72428833c1c548f79d1162ff6be5ce74/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:11.933543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f106e34074d41a083ed6d551071767f, group_id=72428833c1c548f79d1162ff6be5ce74, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:11.936500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:11.952161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a3ac98a5-3efc-4061-a672-a23bef416a4b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:11.953805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a3ac98a5-3efc-4061-a672-a23bef416a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:11.955398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 151/299] 10.222.0.58 () {58 vars in 1464 bytes} [Fri Aug 27 03:17:11 2021] PUT /identity/v3/projects/5f106e34074d41a083ed6d551071767f/groups/72428833c1c548f79d1162ff6be5ce74/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:12.026546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 149/300] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:12.053482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:12.068372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b3b6-7f68-4527-8eaf-9d782d89e922 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:12.075548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:12.076391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:12.076672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:12.076944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:12.100129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:12.107626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:12.109233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 152/301] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:12.116661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac98a5-3efc-4061-a672-a23bef416a4b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:12.127512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac98a5-3efc-4061-a672-a23bef416a4b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:12.138626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:12.139766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:12.140253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:12.140748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:12.141755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:12.142980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:12.144904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:12.154484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 150/302] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:12.163391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:12.175964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3b099-9add-4b52-b27a-78b7dbfcdedc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:12.186024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:12.187171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:12.187684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:12.188127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:12.189853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:12.192627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:12.195319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 153/303] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:12 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:12.203398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:12.213942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c4974-e6bc-4aaa-a735-ec4201b750e1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:12.218627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af49c5-9436-4c33-a128-8f7ee2b1ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:12.220029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af49c5-9436-4c33-a128-8f7ee2b1ef9a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:12.220639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af49c5-9436-4c33-a128-8f7ee2b1ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:12.221023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af49c5-9436-4c33-a128-8f7ee2b1ef9a admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:12.224464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af49c5-9436-4c33-a128-8f7ee2b1ef9a admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:12.226661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af49c5-9436-4c33-a128-8f7ee2b1ef9a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:12.228829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 151/304] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:12 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:12.234741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:12.247777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb7ac9-172d-4933-94c4-77db5d2cebfc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:12.255117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6df20-43fb-48d1-b5e0-75906f3eba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:12.256199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6df20-43fb-48d1-b5e0-75906f3eba41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:12.256622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6df20-43fb-48d1-b5e0-75906f3eba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:12.257025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6df20-43fb-48d1-b5e0-75906f3eba41 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f/groups/72428833c1c548f79d1162ff6be5ce74/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:12.260101 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6df20-43fb-48d1-b5e0-75906f3eba41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f106e34074d41a083ed6d551071767f, group_id=72428833c1c548f79d1162ff6be5ce74, role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:12.262890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6df20-43fb-48d1-b5e0-75906f3eba41 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:12.284132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 154/305] 10.222.0.58 () {58 vars in 1464 bytes} [Fri Aug 27 03:17:12 2021] PUT /identity/v3/projects/5f106e34074d41a083ed6d551071767f/groups/72428833c1c548f79d1162ff6be5ce74/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:13.078893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee8cca-1643-4ae2-837b-d60737bbc1c9 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.079315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee8cca-1643-4ae2-837b-d60737bbc1c9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.080155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee8cca-1643-4ae2-837b-d60737bbc1c9 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.082213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 152/306] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:13.088246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8deda-b2a5-43aa-9515-1909861f316a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.088710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8deda-b2a5-43aa-9515-1909861f316a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.089128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8deda-b2a5-43aa-9515-1909861f316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.116406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-07f8deda-b2a5-43aa-9515-1909861f316a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:13.117844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-07f8deda-b2a5-43aa-9515-1909861f316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:13.201646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 155/307] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:13.247277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee8cca-1643-4ae2-837b-d60737bbc1c9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.253317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e903fe9-0a8d-433b-90c4-fb067eb97c19 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.253839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e903fe9-0a8d-433b-90c4-fb067eb97c19 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.254257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e903fe9-0a8d-433b-90c4-fb067eb97c19 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.256605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 156/308] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:13.261971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209a72d-80ab-421d-b044-adb8d9d94ab5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.262419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209a72d-80ab-421d-b044-adb8d9d94ab5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.262858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209a72d-80ab-421d-b044-adb8d9d94ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.272041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee8cca-1643-4ae2-837b-d60737bbc1c9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.276698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.277498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.277779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.278054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.286279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c209a72d-80ab-421d-b044-adb8d9d94ab5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:13.287761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c209a72d-80ab-421d-b044-adb8d9d94ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:13.300830 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:13.302098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 157/309] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:13.308774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:13.310178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 153/310] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:13.317293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209a72d-80ab-421d-b044-adb8d9d94ab5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.329177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.333349 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209a72d-80ab-421d-b044-adb8d9d94ab5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.344003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.345108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.345402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.345678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4814c0-1bea-4d66-a3c5-24174e7a3a27 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.345785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.346615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] RBAC: Adding query filter params (name=member) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:13.346928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.348576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.358014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.358803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.359086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.359377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.362865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 158/311] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:13.373105 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.386567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:13.394473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:13.395740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 154/312] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:13.397973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56f3d0-c09f-4007-bd4c-3286b20bbc5c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.405857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.413572 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.414237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.414519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.414794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.427001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e1cd-7fd8-47ed-adda-9d3f5cf98061 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.428421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.430197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.442981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.443694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.443977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.444254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.445016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:13.445325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.447210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.452686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 159/313] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:13.463143 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.472502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 155/314] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:13.477643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4c4e-1657-46e5-a1f9-edb18c990381 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.479177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.492363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396246a9-e0ce-457d-9f9a-14c79bfa4f25 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.493571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.494454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.494733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.495009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.496260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.498323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.500243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 160/315] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:13.501223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.502615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.503112 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.503639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] PATH_INFO: `/v3/groups/580d3a2579f448b6b667a42a40bcfb03` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.505076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] RBAC: Authorizing `identity:get_group(group_id=580d3a2579f448b6b667a42a40bcfb03)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.506851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.508905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.510803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 156/316] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/groups/580d3a2579f448b6b667a42a40bcfb03 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:13.517026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.519684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb88c88-ae10-408c-8df5-7a32954fccf3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.529904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.530866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.531152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.531460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.532206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ac6d-4419-4871-b0cc-111ab6fe538f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.533605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.536664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.539765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 161/317] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:13.545461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.546450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.546791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.547108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] PATH_INFO: `/v3/projects/dd18f6074b9647bca69baffc389eb123` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.549147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd18f6074b9647bca69baffc389eb123)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.551477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.553442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 157/318] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/projects/dd18f6074b9647bca69baffc389eb123 => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:13.558570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.569852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:13.575028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80fea-c2e4-4059-8d43-eb177bda580a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.587033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe2851-de20-4502-8e31-94b531215c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.587747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2851-de20-4502-8e31-94b531215c12 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.588039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2851-de20-4502-8e31-94b531215c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.588316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe2851-de20-4502-8e31-94b531215c12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.589742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a15f0e-9bd1-40b9-871f-f7bb396504c9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:13.590917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2851-de20-4502-8e31-94b531215c12 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:13.591646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2851-de20-4502-8e31-94b531215c12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.596141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe2851-de20-4502-8e31-94b531215c12 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.600002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa779d85-2f4e-48b7-a320-151ccb1497a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:13.600912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779d85-2f4e-48b7-a320-151ccb1497a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:13.601209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779d85-2f4e-48b7-a320-151ccb1497a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:13.601464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa779d85-2f4e-48b7-a320-151ccb1497a4 admin admin] PATH_INFO: `/v3/projects/dd18f6074b9647bca69baffc389eb123/groups/580d3a2579f448b6b667a42a40bcfb03/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:13.603828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 162/319] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:13 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:13.613015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa779d85-2f4e-48b7-a320-151ccb1497a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd18f6074b9647bca69baffc389eb123, group_id=580d3a2579f448b6b667a42a40bcfb03, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:13.613015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa779d85-2f4e-48b7-a320-151ccb1497a4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:13.640827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 158/320] 10.222.0.58 () {58 vars in 1464 bytes} [Fri Aug 27 03:17:13 2021] PUT /identity/v3/projects/dd18f6074b9647bca69baffc389eb123/groups/580d3a2579f448b6b667a42a40bcfb03/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:14.384541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124ae9-a6b0-4753-8ea8-3dee7a97cc5b None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.385060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124ae9-a6b0-4753-8ea8-3dee7a97cc5b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.385168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124ae9-a6b0-4753-8ea8-3dee7a97cc5b None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.387047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 163/321] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:14.392913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef723-1667-4db4-af39-dcd00ea25558 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.393352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef723-1667-4db4-af39-dcd00ea25558 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.393529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef723-1667-4db4-af39-dcd00ea25558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.414087 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-e7cef723-1667-4db4-af39-dcd00ea25558 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:14.415278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e7cef723-1667-4db4-af39-dcd00ea25558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:14.484511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 159/322] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:14.511034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51124ae9-a6b0-4753-8ea8-3dee7a97cc5b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.528072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51124ae9-a6b0-4753-8ea8-3dee7a97cc5b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.533517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.534343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.534623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.534898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.551834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:14.559400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:14.563129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 164/323] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:14.570242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef723-1667-4db4-af39-dcd00ea25558 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.580297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef723-1667-4db4-af39-dcd00ea25558 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.593834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.595008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.595535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.595999 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.596967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:14.597508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.599427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.611126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 160/324] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:14.617575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.628295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb16d0-fa24-4791-bfc9-7476251919b4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.633124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5c1c6-ff4b-4836-a3d5-3e4021181011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.634013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c1c6-ff4b-4836-a3d5-3e4021181011 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.634475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c1c6-ff4b-4836-a3d5-3e4021181011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.634987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5c1c6-ff4b-4836-a3d5-3e4021181011 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.643865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c1c6-ff4b-4836-a3d5-3e4021181011 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.645945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5c1c6-ff4b-4836-a3d5-3e4021181011 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.655660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 165/325] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:14.662370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.669480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7c7f-7ec5-4efb-87d7-1be38db348e7 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.669769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7c7f-7ec5-4efb-87d7-1be38db348e7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.670033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7c7f-7ec5-4efb-87d7-1be38db348e7 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.671836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 166/326] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:14.674011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6a5ed-dcf8-436f-b00c-310a20aa8aba admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.677740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa292-27b8-4fc5-8185-75820ec300cf None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.678025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa292-27b8-4fc5-8185-75820ec300cf None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.678296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa292-27b8-4fc5-8185-75820ec300cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.679467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.680812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.681329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.681958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.683787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.686139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.688568 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 161/327] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:14.694783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.697041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-09aaa292-27b8-4fc5-8185-75820ec300cf None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:14.698223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-09aaa292-27b8-4fc5-8185-75820ec300cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:14.708285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 167/328] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:14.709141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8f206-74db-4f35-966b-6315708cabb8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.713942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.715064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.715575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.716093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.717518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.719886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.722230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 162/329] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:14.729071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaa292-27b8-4fc5-8185-75820ec300cf None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.733720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.742733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaa292-27b8-4fc5-8185-75820ec300cf None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.744514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e41b-2678-4cee-9c92-f576d1999b95 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.748622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.748770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.749769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.749981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.750077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.750305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.750909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.751398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.752779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:14.753542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.755841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.762278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:14.763941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 168/330] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:14.770949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 03:17:14.772425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 163/331] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:14.779071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.789929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cfbfc-b371-4d4b-adde-f2bffdb7f537 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.795027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.796020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.796438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.796921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.798079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:14.798542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.800492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.810900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 169/332] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:14.817149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.827900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028a7c5-67e2-4cf5-a759-027309d1a2f0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.832825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.833637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.834013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.834380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.843474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.845846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.856149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 164/333] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:14.863607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.874078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6578101-f931-41b3-bebe-e0ef982a4884 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.879525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.880753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.881172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.881580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.883152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.885574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.887704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 170/334] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:14.898632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.904076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623e39-a3a7-4dfa-a9a2-47de7d965889 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.908914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f474a62-1a0e-476f-b3cb-d8bed5ba6c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.909932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f474a62-1a0e-476f-b3cb-d8bed5ba6c1c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.910350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f474a62-1a0e-476f-b3cb-d8bed5ba6c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.910745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f474a62-1a0e-476f-b3cb-d8bed5ba6c1c admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.912173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f474a62-1a0e-476f-b3cb-d8bed5ba6c1c admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.914330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f474a62-1a0e-476f-b3cb-d8bed5ba6c1c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.916298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 165/335] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:14.924059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:14.934998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87953a3f-f876-4303-8f2e-6569497e517d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:14.940885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9b849-0c7d-45d7-9c4b-694f59892110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:14.941861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9b849-0c7d-45d7-9c4b-694f59892110 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:14.942346 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9b849-0c7d-45d7-9c4b-694f59892110 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:14.942768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9b849-0c7d-45d7-9c4b-694f59892110 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:14.943831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9b849-0c7d-45d7-9c4b-694f59892110 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=55c10f17e7054dcc8c972f27c8c835ec, scope.project.id=5f106e34074d41a083ed6d551071767f) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:14.944295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9b849-0c7d-45d7-9c4b-694f59892110 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:14.946370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9b849-0c7d-45d7-9c4b-694f59892110 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:14.953641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 171/336] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:14 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=55c10f17e7054dcc8c972f27c8c835ec => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:15.073535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da7f1-afe2-4805-beeb-54ea288fe560 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.073887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da7f1-afe2-4805-beeb-54ea288fe560 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.074088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da7f1-afe2-4805-beeb-54ea288fe560 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.075927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 166/337] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:15.082652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0659-be88-4612-83aa-a113705ea1bc None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.083093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0659-be88-4612-83aa-a113705ea1bc None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.083493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0659-be88-4612-83aa-a113705ea1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.102588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-901b0659-be88-4612-83aa-a113705ea1bc None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:15.103829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-901b0659-be88-4612-83aa-a113705ea1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:15.115476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 172/338] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:15.135823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da7f1-afe2-4805-beeb-54ea288fe560 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:15.150637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da7f1-afe2-4805-beeb-54ea288fe560 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:15.155668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:15.156479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.156761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.157287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.170008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:15.177804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:15.179262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 167/339] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:15.185855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0659-be88-4612-83aa-a113705ea1bc None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:15.195710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0659-be88-4612-83aa-a113705ea1bc None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:15.201770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:15.202446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.202729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.203005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.203796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:15.204157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:15.206094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:15.215003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 173/340] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:15.221684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:15.231684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06dba2-256d-4fbf-a24b-678a7e651db2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:15.236426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:15.237107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.237363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.237638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.246799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:15.248591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:15.258252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 168/341] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:15.264735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:15.274735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f70663-b96f-49be-94bd-a5fe784c4586 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:15.279194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:15.280163 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.280385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.280666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.281860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:15.284567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:15.286314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 174/342] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:15 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:15.296501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:15.306312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1296b-b502-4cf9-81d3-6aacb7030058 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:15.313911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babc6ba-3e1b-4a07-8316-a1b422e63a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:15.314423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babc6ba-3e1b-4a07-8316-a1b422e63a4b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.314775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babc6ba-3e1b-4a07-8316-a1b422e63a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.315048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babc6ba-3e1b-4a07-8316-a1b422e63a4b admin admin] PATH_INFO: `/v3/groups/72428833c1c548f79d1162ff6be5ce74` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.317182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babc6ba-3e1b-4a07-8316-a1b422e63a4b admin admin] RBAC: Authorizing `identity:get_group(group_id=72428833c1c548f79d1162ff6be5ce74)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:15.318913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babc6ba-3e1b-4a07-8316-a1b422e63a4b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:15.320084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 169/343] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:15 2021] GET /identity/v3/groups/72428833c1c548f79d1162ff6be5ce74 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:15.326493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:15.336643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3c96c-19c5-4135-8ad9-35c1275b8524 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:15.341409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9754ab5-fdd8-445e-9299-5621e5bb2570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:15.342035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754ab5-fdd8-445e-9299-5621e5bb2570 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.342318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754ab5-fdd8-445e-9299-5621e5bb2570 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.342595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9754ab5-fdd8-445e-9299-5621e5bb2570 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.343457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754ab5-fdd8-445e-9299-5621e5bb2570 admin admin] RBAC: Adding query filter params (group.id=72428833c1c548f79d1162ff6be5ce74, role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=5f106e34074d41a083ed6d551071767f) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:15.343772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754ab5-fdd8-445e-9299-5621e5bb2570 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:15.346266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9754ab5-fdd8-445e-9299-5621e5bb2570 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:15.352905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 175/344] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:15 2021] GET /identity/v3/role_assignments?group.id=72428833c1c548f79d1162ff6be5ce74&scope.project.id=5f106e34074d41a083ed6d551071767f&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:15.985435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de1ec-4aa5-4814-84ea-aa5efb457f3a None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.985993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de1ec-4aa5-4814-84ea-aa5efb457f3a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.986110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de1ec-4aa5-4814-84ea-aa5efb457f3a None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:15.989020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 170/345] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:15.998815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58aba-549c-4670-804c-b90aa3c8b2ca None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:15.999220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58aba-549c-4670-804c-b90aa3c8b2ca None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:15.999494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58aba-549c-4670-804c-b90aa3c8b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:16.020716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-def58aba-549c-4670-804c-b90aa3c8b2ca None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:16.021922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-def58aba-549c-4670-804c-b90aa3c8b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:16.030110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:16.055137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9de1ec-4aa5-4814-84ea-aa5efb457f3a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:16.069374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9de1ec-4aa5-4814-84ea-aa5efb457f3a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:16.076682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:16.077919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:16.078385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:16.078837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:16.096782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:16.103478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:16.104611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 171/347] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:16.113806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58aba-549c-4670-804c-b90aa3c8b2ca None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:16.123252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58aba-549c-4670-804c-b90aa3c8b2ca None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:16.129389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:16.130048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:16.130333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:16.130600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:16.131377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:16.131688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:16.133295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:16.142226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 177/348] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:16.148474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:16.165370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64bf98-926d-4370-a1a5-13620e2ad468 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:16.172451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:16.173220 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:16.173496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:16.173770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:16.182262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:16.184394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:16.193517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 172/349] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:16.199919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:16.210083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59ace6-960f-4b5e-bafd-418fc2cc070a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:16.217226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:16.218546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:16.218908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:16.219252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] PATH_INFO: `/v3/projects/dd18f6074b9647bca69baffc389eb123` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:16.220988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd18f6074b9647bca69baffc389eb123)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:16.223892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:16.226423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 178/350] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:17:16 2021] GET /identity/v3/projects/dd18f6074b9647bca69baffc389eb123 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:16.232791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:16.242130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a6daf-4634-4ca2-aca6-3ab9ab0f9ea2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:16.247730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35215b-e2d6-4243-93d7-6cffbcbc7c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:16.248557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35215b-e2d6-4243-93d7-6cffbcbc7c76 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:16.248828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35215b-e2d6-4243-93d7-6cffbcbc7c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:16.249111 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35215b-e2d6-4243-93d7-6cffbcbc7c76 admin admin] PATH_INFO: `/v3/groups/580d3a2579f448b6b667a42a40bcfb03` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:16.250373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35215b-e2d6-4243-93d7-6cffbcbc7c76 admin admin] RBAC: Authorizing `identity:get_group(group_id=580d3a2579f448b6b667a42a40bcfb03)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:16.252427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35215b-e2d6-4243-93d7-6cffbcbc7c76 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:16.253976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 173/351] 10.222.0.58 () {56 vars in 1202 bytes} [Fri Aug 27 03:17:16 2021] GET /identity/v3/groups/580d3a2579f448b6b667a42a40bcfb03 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:16.260094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:16.269974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef028-63c1-4664-86c7-56ad11dfd927 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:16.275212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336c911-fe64-405f-abc4-1b7282dced93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:16.275858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336c911-fe64-405f-abc4-1b7282dced93 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:16.276138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336c911-fe64-405f-abc4-1b7282dced93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:16.276410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336c911-fe64-405f-abc4-1b7282dced93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:16.277225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336c911-fe64-405f-abc4-1b7282dced93 admin admin] RBAC: Adding query filter params (group.id=580d3a2579f448b6b667a42a40bcfb03, role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=dd18f6074b9647bca69baffc389eb123) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:16.277534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336c911-fe64-405f-abc4-1b7282dced93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:16.279328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336c911-fe64-405f-abc4-1b7282dced93 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:16.285250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 179/352] 10.222.0.58 () {56 vars in 1398 bytes} [Fri Aug 27 03:17:16 2021] GET /identity/v3/role_assignments?group.id=580d3a2579f448b6b667a42a40bcfb03&scope.project.id=dd18f6074b9647bca69baffc389eb123&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:18.838706 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05fd0-a521-4f20-8f39-804d1a1d6016 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:18.839853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05fd0-a521-4f20-8f39-804d1a1d6016 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:18.840345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05fd0-a521-4f20-8f39-804d1a1d6016 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:18.842558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 174/353] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:18.849329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69015-2244-4495-8bbc-8eb504e1d90c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:18.850238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69015-2244-4495-8bbc-8eb504e1d90c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:18.850727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69015-2244-4495-8bbc-8eb504e1d90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:18.870276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-99b69015-2244-4495-8bbc-8eb504e1d90c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:18.871825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-99b69015-2244-4495-8bbc-8eb504e1d90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:18.884769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 180/354] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:18.930373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05fd0-a521-4f20-8f39-804d1a1d6016 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:18.948204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05fd0-a521-4f20-8f39-804d1a1d6016 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:18.952841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:18.953920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:18.954470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:18.954913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:18.970125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:18.972285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:18.992705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:18.994224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 175/355] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:19.001127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b69015-2244-4495-8bbc-8eb504e1d90c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.010708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b69015-2244-4495-8bbc-8eb504e1d90c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.019543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ada96-5105-48e7-9b39-2b8d947d8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.020486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ada96-5105-48e7-9b39-2b8d947d8c34 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.020935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ada96-5105-48e7-9b39-2b8d947d8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.021374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ada96-5105-48e7-9b39-2b8d947d8c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.022304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ada96-5105-48e7-9b39-2b8d947d8c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:19.022775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ada96-5105-48e7-9b39-2b8d947d8c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.024616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ada96-5105-48e7-9b39-2b8d947d8c34 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.041330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 181/356] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:19.048016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.058557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d500533-6cbe-4810-bff3-aa45585aca6d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.063763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c194f5-aace-48ac-8a30-a692446c33db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.064624 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c194f5-aace-48ac-8a30-a692446c33db admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.065073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c194f5-aace-48ac-8a30-a692446c33db admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.065513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c194f5-aace-48ac-8a30-a692446c33db admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.066436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c194f5-aace-48ac-8a30-a692446c33db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.068563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c194f5-aace-48ac-8a30-a692446c33db admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.099762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 176/357] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:17:19 2021] POST /identity/v3/users => generated 246 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:17:19.524539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836173-8935-4940-af16-e96b10482546 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.524836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836173-8935-4940-af16-e96b10482546 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.525096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1836173-8935-4940-af16-e96b10482546 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.527414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 182/358] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:19.534290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a1d9-ad90-494a-935d-e39504155e18 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.534905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a1d9-ad90-494a-935d-e39504155e18 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.535424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8a1d9-ad90-494a-935d-e39504155e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.558428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-37a8a1d9-ad90-494a-935d-e39504155e18 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:19.559979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-37a8a1d9-ad90-494a-935d-e39504155e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:19.574239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 177/359] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:19.594630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88325a06-00c8-4731-98b6-7ddaa54ef578 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.595029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88325a06-00c8-4731-98b6-7ddaa54ef578 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.595576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88325a06-00c8-4731-98b6-7ddaa54ef578 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.597805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 183/360] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:19.604041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5cd1d-549d-486c-9e36-9ccd5bc1a0ba None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.604632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5cd1d-549d-486c-9e36-9ccd5bc1a0ba None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.605096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5cd1d-549d-486c-9e36-9ccd5bc1a0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.610416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88325a06-00c8-4731-98b6-7ddaa54ef578 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.630097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88325a06-00c8-4731-98b6-7ddaa54ef578 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.631295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-33d5cd1d-549d-486c-9e36-9ccd5bc1a0ba None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:19.632703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-33d5cd1d-549d-486c-9e36-9ccd5bc1a0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:19.634676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275e377-33cb-4034-8303-b6e7f31939b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.635773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275e377-33cb-4034-8303-b6e7f31939b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.636065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275e377-33cb-4034-8303-b6e7f31939b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.636343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275e377-33cb-4034-8303-b6e7f31939b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.642554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 178/361] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:19.651520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275e377-33cb-4034-8303-b6e7f31939b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.653308 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275e377-33cb-4034-8303-b6e7f31939b2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.662174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfcfb5-c7cf-431d-8217-2a6e5faf9c14 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.662718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfcfb5-c7cf-431d-8217-2a6e5faf9c14 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.663204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfcfb5-c7cf-431d-8217-2a6e5faf9c14 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.665517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 179/362] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:19.668335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfcfb5-c7cf-431d-8217-2a6e5faf9c14 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.671588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-1275e377-33cb-4034-8303-b6e7f31939b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:19.673459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 184/363] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:19.674740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c79678-ce07-4698-8c7d-fcb606cb0c02 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.675032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c79678-ce07-4698-8c7d-fcb606cb0c02 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.675310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c79678-ce07-4698-8c7d-fcb606cb0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.685303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfcfb5-c7cf-431d-8217-2a6e5faf9c14 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.689399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.690201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.690473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.690742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.697016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b8c79678-ce07-4698-8c7d-fcb606cb0c02 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:19.698635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b8c79678-ce07-4698-8c7d-fcb606cb0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:19.701510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.703486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.708357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 185/364] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:19.709183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c79678-ce07-4698-8c7d-fcb606cb0c02 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.719625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c79678-ce07-4698-8c7d-fcb606cb0c02 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.720528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:19.721950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 180/365] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:19.728123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.737297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.737987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.738262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.738528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.739264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:19.739586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.741178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.747002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd474f-a266-4859-8438-62958405e3aa admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.753508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.754533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 186/366] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:19.754922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.755436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.755970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.756923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:19.757438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.758656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:19.758656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:19.758656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:19.759905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.760159 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.769816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536f52b-e2c2-4bc8-9dfc-a3b5abab9943 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.774449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.775238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.775550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.775822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.783576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 181/367] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:19.784678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.791853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.793400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.796273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161792a-3974-483f-bfa0-d814720a3147 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.802289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.803527 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.804014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.804487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.805412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.807583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.810630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:19.811858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 187/368] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:19.812606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.822189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909d466-9d47-41b4-9eb7-39d4d6b98e87 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.827389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.831375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.831375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.831375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.831375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.831375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:19.831375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:19.831375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:19.831846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.832360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 182/369] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:17:19 2021] POST /identity/v3/users => generated 248 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:19.833364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.854129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51344993-50ac-41d2-b03c-044be6d4b8dd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.864464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd99ebb-da36-4e87-9e56-c286e8722d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.866943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd99ebb-da36-4e87-9e56-c286e8722d34 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.867745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd99ebb-da36-4e87-9e56-c286e8722d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.868025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd99ebb-da36-4e87-9e56-c286e8722d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.870418 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd99ebb-da36-4e87-9e56-c286e8722d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:19.871651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd99ebb-da36-4e87-9e56-c286e8722d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.873728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd99ebb-da36-4e87-9e56-c286e8722d34 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.887801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 188/370] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:17:19 2021] POST /identity/v3/users => generated 249 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:19.896191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 183/371] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:19.902625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:19.917073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e1c9b-1b21-4723-a6c3-9070c511d82c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:19.925337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac68d61-4dd3-44db-af56-ca82374aa7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:19.926047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68d61-4dd3-44db-af56-ca82374aa7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:19.926325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68d61-4dd3-44db-af56-ca82374aa7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:19.926600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac68d61-4dd3-44db-af56-ca82374aa7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:19.927330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68d61-4dd3-44db-af56-ca82374aa7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:19.929344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac68d61-4dd3-44db-af56-ca82374aa7d9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:19.961267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 189/372] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:17:19 2021] POST /identity/v3/users => generated 248 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:20.636681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283282e-8a6f-4e8d-8897-8cbba35c2aae None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:20.637056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283282e-8a6f-4e8d-8897-8cbba35c2aae None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:20.637227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283282e-8a6f-4e8d-8897-8cbba35c2aae None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:20.639006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 184/373] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:20.645213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ccf8-5ec7-4396-98c7-2a6ecd70dd1f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:20.645424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ccf8-5ec7-4396-98c7-2a6ecd70dd1f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:20.645708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ccf8-5ec7-4396-98c7-2a6ecd70dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:20.668000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d284ccf8-5ec7-4396-98c7-2a6ecd70dd1f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:20.669207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d284ccf8-5ec7-4396-98c7-2a6ecd70dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:20.679279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 190/374] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:20.720255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283282e-8a6f-4e8d-8897-8cbba35c2aae None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:20.736213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283282e-8a6f-4e8d-8897-8cbba35c2aae None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:20.740810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:20.741492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:20.741774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:20.742053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:20.742797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:20.745430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:20.754870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.sql.core [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 03:17:20.754870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 03:17:20.754870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [parameters: {'id': '929f1702b4f6483fb56f92bb9a35a3c2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 03:17:20.754870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73389) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 03:17:20.769005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 03:17:20.770677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 185/375] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:17:20 2021] POST /identity/v3/roles => generated 144 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:20.777166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284ccf8-5ec7-4396-98c7-2a6ecd70dd1f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:20.786522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284ccf8-5ec7-4396-98c7-2a6ecd70dd1f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:20.795328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cd12c-989b-4875-a727-1fe25f1f378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:20.796165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd12c-989b-4875-a727-1fe25f1f378d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:20.796442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd12c-989b-4875-a727-1fe25f1f378d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:20.796706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd12c-989b-4875-a727-1fe25f1f378d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:20.807544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cd12c-989b-4875-a727-1fe25f1f378d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:20.819070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-458cd12c-989b-4875-a727-1fe25f1f378d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 03:17:20.820500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 191/376] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:20.826751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:20.837925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f2ded-39ba-427e-a7bf-bd342e64451f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:20.847016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6db7ec-c709-4d71-a208-a33ab5f77f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:20.847707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db7ec-c709-4d71-a208-a33ab5f77f12 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:20.847989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db7ec-c709-4d71-a208-a33ab5f77f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:20.848264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db7ec-c709-4d71-a208-a33ab5f77f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:20.849013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db7ec-c709-4d71-a208-a33ab5f77f12 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:20.849317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db7ec-c709-4d71-a208-a33ab5f77f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:20.850945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db7ec-c709-4d71-a208-a33ab5f77f12 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:20.859784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 186/377] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:21.943551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a23c-b85d-4fdc-86e7-b8d5b2116157 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:21.944285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a23c-b85d-4fdc-86e7-b8d5b2116157 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:21.944285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7a23c-b85d-4fdc-86e7-b8d5b2116157 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:21.945874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 192/378] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:21.961380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de567ce2-e908-4254-88fa-334ed6cecda5 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:21.961916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de567ce2-e908-4254-88fa-334ed6cecda5 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:21.961916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de567ce2-e908-4254-88fa-334ed6cecda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:21.987643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-de567ce2-e908-4254-88fa-334ed6cecda5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:21.988850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-de567ce2-e908-4254-88fa-334ed6cecda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:22.001877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 187/379] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:22.042113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a23c-b85d-4fdc-86e7-b8d5b2116157 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.060617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7a23c-b85d-4fdc-86e7-b8d5b2116157 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.069902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.070982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.071497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.071970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.089721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:22.097254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:22.099024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 193/380] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.105378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de567ce2-e908-4254-88fa-334ed6cecda5 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.120643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de567ce2-e908-4254-88fa-334ed6cecda5 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.132105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.132797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.133072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.133340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.134101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.134403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.136063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.149548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 188/381] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.155710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.172394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1554f0-47eb-4fe7-b1b7-b7cab00a9dff admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.183856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.184975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.185457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.185927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.208296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.210524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.234888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:22.237038 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 194/382] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.245752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.263950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84d7e-ba77-4978-a39f-22d2ecf968dc admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.272011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.272680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.272959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.273227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.273952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.274249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.275926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.292814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 189/383] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.298779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.312733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68267a-dcd1-4eb5-aa11-9e2d23a5d23f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.323558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.324660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.325139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.325603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.344586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.347189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.365244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:17:22.366748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 195/384] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/users/nova => generated 82 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.373135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.400236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b4f8e-274c-41d8-b64c-7b5e24ad5d43 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.408993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.409675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.409951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.410220 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.411224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.411554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.412580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:22.412580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:22.412580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:22.413697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adae887-3c7c-42e7-9587-121e3478904b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.588605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 190/385] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.594587 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.615401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b7a23-d4fd-489f-9315-8e9efaf2148e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.628954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.629994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.630502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.630973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.634488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3570c-2a0c-47a6-b806-af4f0f8ddf18 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.634772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3570c-2a0c-47a6-b806-af4f0f8ddf18 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.635046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3570c-2a0c-47a6-b806-af4f0f8ddf18 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.636845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 191/386] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:22.644774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea724b-4764-4551-a4a4-85c0e5887f99 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.645124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea724b-4764-4551-a4a4-85c0e5887f99 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.645329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea724b-4764-4551-a4a4-85c0e5887f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.647661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.649680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.664487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 196/387] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:22.672704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.674031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c2ea724b-4764-4551-a4a4-85c0e5887f99 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:22.675287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c2ea724b-4764-4551-a4a4-85c0e5887f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:22.683484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7b687-d78c-4833-a01e-e451942b6b07 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.687569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 192/388] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:22.687569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049daebb-165e-4d94-9da7-59bd7a2ebb55 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.687569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049daebb-165e-4d94-9da7-59bd7a2ebb55 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.687569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049daebb-165e-4d94-9da7-59bd7a2ebb55 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.687569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 193/389] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:22.693413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47aec-f9d5-4035-8e2f-f52a640ba84c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.693673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47aec-f9d5-4035-8e2f-f52a640ba84c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.693956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e47aec-f9d5-4035-8e2f-f52a640ba84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.699455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4daa05-719d-4f30-b496-3ac5379a3da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.700260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4daa05-719d-4f30-b496-3ac5379a3da2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.700535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4daa05-719d-4f30-b496-3ac5379a3da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.700807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4daa05-719d-4f30-b496-3ac5379a3da2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.717532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4daa05-719d-4f30-b496-3ac5379a3da2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.717962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-26e47aec-f9d5-4035-8e2f-f52a640ba84c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:22.719164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-26e47aec-f9d5-4035-8e2f-f52a640ba84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:22.719933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4daa05-719d-4f30-b496-3ac5379a3da2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.727057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 194/390] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:22.728402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691143-661f-420e-b239-6fe69c8d5185 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.728683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691143-661f-420e-b239-6fe69c8d5185 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.728956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691143-661f-420e-b239-6fe69c8d5185 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.730727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 195/391] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:22.731279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691143-661f-420e-b239-6fe69c8d5185 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.743859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-ca4daa05-719d-4f30-b496-3ac5379a3da2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:22.750023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 197/392] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.751622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691143-661f-420e-b239-6fe69c8d5185 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.751843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7f39-abd5-4531-831c-a531980e6ce1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.752132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7f39-abd5-4531-831c-a531980e6ce1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.752397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab7f39-abd5-4531-831c-a531980e6ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.756524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.757341 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.757621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.757893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.770743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:22.770899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e4ab7f39-abd5-4531-831c-a531980e6ce1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:22.772002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e4ab7f39-abd5-4531-831c-a531980e6ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:22.777576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:22.778919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 196/393] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.783438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.783562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 198/394] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:22.783562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab7f39-abd5-4531-831c-a531980e6ce1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.793011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab7f39-abd5-4531-831c-a531980e6ce1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.797448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.798241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.798523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.798795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.801974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9cb45-8bea-47af-ad50-b258c216bdba admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.806988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.807685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.808278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.808554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.809285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.809534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:22.809630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.811191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.816468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:22.817856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 199/395] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.818503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.825745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 197/396] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.826569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.832858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd739ef-746e-45a0-ab58-3e2fa6c19ebf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.836258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acd832-3d31-4a32-983f-4ab46725acdd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.837136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.837786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.838065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.838334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.839127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.839426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.840699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.841012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.841468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.841744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.842013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.856054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 200/397] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.856054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.857537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:22.860863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cf1ed-8105-4fd0-8f6e-9e9bee479174 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.864262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:22.865633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 198/398] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.865749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.866283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.866620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.866889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.867623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.867920 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.869481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.871465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.878562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 201/399] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.879141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.886763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3281c9-b883-4b77-aed5-b7d59762ff37 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.888134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551958d1-219a-4318-b1e1-92330736201d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.892569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.893359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.893626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.894000 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.894106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.894383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.894506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.894648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.902248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.904359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.905750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.908130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.917718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:22.919213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 199/400] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.920035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.925630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:22.927883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 202/401] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.927883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.934572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493d28d-ea12-46cb-813e-56366979e619 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.937290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baaead-c694-40bb-b90e-78275e008c21 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.939916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.940576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.940845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.941116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.941591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.941861 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.942175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.942339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.942574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.942836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.943818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.957524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 200/402] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.957661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.958076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.958171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.966565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c106c-50a7-44e2-9f7c-72d5c3cefe64 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.971075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:22.971734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:22.972016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:22.972287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:22.973053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:22.973362 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:22.974377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:22.974377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:22.974377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:22.974753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:22.975570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:22.976155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 203/403] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:22.980224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:22.994386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809e4b0-4aef-4199-9629-41ff50fb4e79 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:22.996989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 201/404] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:22.996989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.004153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.004988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.005406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.005683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.006403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.006708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.008336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.008914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d793c-c637-4550-9b2a-fc247956e0db admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.013301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.014086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.014365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.014639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.024886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 204/405] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.024886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.028941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.030807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.033817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f252a-7073-4240-8bb9-ba57160ae8eb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.038119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.038746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.039028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.039296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.040040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.040368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.041890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.047966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:23.049461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 202/406] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.050409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.058580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 205/407] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.059381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.068535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb663e-4b82-40ad-842d-fc1f236d8b96 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.068725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9611c80-1e31-447b-9c4d-fd53a1d79c03 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.073593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.073791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.074350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.074623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.074890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.075195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.075817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.076260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.077917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=068da11e10ca4a788bb08a42206ca42e) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.078413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.080696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.082273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.084280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.087910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 203/408] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/role_assignments?user.id=068da11e10ca4a788bb08a42206ca42e&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.088864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.098494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 03:17:23.099721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 206/409] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/users/glance => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.100490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.105730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04431c70-b25b-47dc-bc9c-9765bea3ae79 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.110310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccc3e0-cca6-4160-8bb4-40eef7515759 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.111743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.112674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.113109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.113456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.114340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.114735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.115052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.115899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.116224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.116496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.116784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.125639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.127914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.132502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 204/410] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.133677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.143540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:17:23.144896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 207/411] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.145293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9725eb3-773b-4616-991e-13beb7bfd3e0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.145868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.150672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.151832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.152280 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.152700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.154282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.155026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.157143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.157540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82d784-65a4-4d94-80ae-1a5cd7353ab3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.164881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.165935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.166327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.166697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.175164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.177415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.182272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 205/412] 10.222.0.58 () {56 vars in 1159 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.183784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.193490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 03:17:23.194935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb983-c3ba-419a-ab27-247337b0327b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.195277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 208/413] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/users/neutron => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.196168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.200318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.201233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.201925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.202384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.204137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.204602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.206952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.207761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd7bc1-b681-4262-abdc-30642617d12d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.212556 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.213359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.213735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.214099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.223404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.225494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.229633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 206/414] 10.222.0.58 () {56 vars in 1159 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.230890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.236188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 209/415] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:23.237018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.243277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e3f88-67fb-4772-a228-4e70693c2e20 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.246494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03762d-9938-4609-81e5-f0351ee27cf8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.248500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.249566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.250072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.250480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.251664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.252046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.252289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.252901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.253309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.253713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.254838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.262627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.264722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.278135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 207/416] 10.222.0.58 () {56 vars in 1161 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.279009 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.284625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 210/417] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:23.291206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.294248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9b8b5-1585-4ae8-92e5-550e31c0f738 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.301518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0823366-62f8-4990-acdb-98cf2f63e2e6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.302079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.303717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.304317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.304759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.309021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.309772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.310119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.310462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.324584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.324899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.326502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.326792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.339204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 211/418] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:23.340485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.346963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:23.348365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 208/419] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.349494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.356982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea574d-3a5f-4789-a9ae-6456787ff295 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.360743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7a936-77d5-4146-99da-76ee52102215 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.362687 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.363702 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.364128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.364580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.366176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.367493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.368044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.368884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.381665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.383064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.384374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.385334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.404324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:23.405617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:23.406041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 209/420] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.407158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.411461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 212/421] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.412684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.423084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc7ca-b54f-4553-8d70-c76553c29c7a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.423652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65e7e9-f8c5-4ada-b2a1-ee93566237aa admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.427901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.428549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.428828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.429106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.429548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.429836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.430139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.430864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.431329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.431771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.432038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.433325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.434034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.436411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.445594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 213/422] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.446565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.456450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 210/423] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.457106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd33d6b-8d64-492b-b81f-7af2047dc2d9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.457317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.468395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.469446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.469716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.469996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.471009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.471319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.471545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd0e9-c1f6-4d08-8ef4-65101755d8ce admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.473135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.476787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.477682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.478053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.478414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.487110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.489261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.491438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 214/424] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.492705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.505126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e2670-afe5-48db-be47-17ad65cdd84e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.506403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:23.511430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 211/425] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.512339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.515332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.518253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.518683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.519069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.527645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5a60-7869-4204-97b9-52bd4f5d6125 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.528080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.530695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.532858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.534123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.534539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.534945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.542320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.544479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.546762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:23.548638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 215/426] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.549560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.559622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:23.560990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27f20a-2c7b-4ff4-b3e1-07623a1072b0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.561145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 212/427] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.562027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.577363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.578315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.578534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172142bf-d6fb-460d-9e09-be49f8468707 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.578846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.579216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.580477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.580987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.582460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:23.582460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:23.582460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:23.584167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.584514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.585344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.585763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.586185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.587446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.587889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.590417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.604956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 216/428] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.609636 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.610215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 213/429] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.611235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.616921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b7a77-1056-486c-96bc-01ee8a90e135 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.622380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.623137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.623673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f20e77-4e20-4030-b242-0ad7bfe23f13 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.623787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.624131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.625218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.625827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.628394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.629317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.630104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.630724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.631134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.632587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=b43f60d8ae5f4e8cb3ba57f76777ac84) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.633038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.635142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.643133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 214/430] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/role_assignments?user.id=b43f60d8ae5f4e8cb3ba57f76777ac84&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.644313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.647484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 217/431] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.660514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.664318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682afc-2d30-4ac7-bfbf-897e3ffb7741 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.669638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a1aa9-9333-4b1b-a666-1838ea0c7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.671044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1aa9-9333-4b1b-a666-1838ea0c7c06 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.671044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1aa9-9333-4b1b-a666-1838ea0c7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.671246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a1aa9-9333-4b1b-a666-1838ea0c7c06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.672308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a1aa9-9333-4b1b-a666-1838ea0c7c06 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=3357ca71ec4443f8a9fba9b7ac4cfdd0) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.679525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a1aa9-9333-4b1b-a666-1838ea0c7c06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.679525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a1aa9-9333-4b1b-a666-1838ea0c7c06 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.682137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 215/432] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/role_assignments?user.id=3357ca71ec4443f8a9fba9b7ac4cfdd0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.683186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94965d8e-e533-405c-a29e-1eacbebca3b1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.700319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6d11c-5551-45fd-952b-7b3225c4433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.701323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6d11c-5551-45fd-952b-7b3225c4433c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.701756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6d11c-5551-45fd-952b-7b3225c4433c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.702176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6d11c-5551-45fd-952b-7b3225c4433c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.703221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6d11c-5551-45fd-952b-7b3225c4433c admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=d5d8aa6c0fa94ced8f7b277572b06dc0) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.703889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6d11c-5551-45fd-952b-7b3225c4433c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.706167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6d11c-5551-45fd-952b-7b3225c4433c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.712916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 218/433] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/role_assignments?user.id=d5d8aa6c0fa94ced8f7b277572b06dc0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.738292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af83a3-3128-44a6-bfa1-e0047f0a44ba None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.738742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af83a3-3128-44a6-bfa1-e0047f0a44ba None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.739120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af83a3-3128-44a6-bfa1-e0047f0a44ba None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.741196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 216/434] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:23.748014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446959-8195-448f-8955-585a0bf61914 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.748563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446959-8195-448f-8955-585a0bf61914 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.748982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446959-8195-448f-8955-585a0bf61914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.780779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-13446959-8195-448f-8955-585a0bf61914 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:23.782382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-13446959-8195-448f-8955-585a0bf61914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:23.790998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 219/435] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:23.828810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af83a3-3128-44a6-bfa1-e0047f0a44ba None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.842522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af83a3-3128-44a6-bfa1-e0047f0a44ba None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.847861 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.848899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.849327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.849750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.864857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.866994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.886318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:23.888123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 217/436] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:23.895785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446959-8195-448f-8955-585a0bf61914 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.906111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446959-8195-448f-8955-585a0bf61914 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.911767 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade3506-5f8c-40fe-9e86-4c0d0f709150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.912612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3506-5f8c-40fe-9e86-4c0d0f709150 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.913022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3506-5f8c-40fe-9e86-4c0d0f709150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.913372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3506-5f8c-40fe-9e86-4c0d0f709150 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.914221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3506-5f8c-40fe-9e86-4c0d0f709150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:23.914629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3506-5f8c-40fe-9e86-4c0d0f709150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.916515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3506-5f8c-40fe-9e86-4c0d0f709150 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.934425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 220/437] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:23.939082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:23.949535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e94a92-de68-4e23-94d2-cdf419ebad5a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:23.954754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e5f1-28fc-4bdb-a6fb-a47bb2d9622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:23.955632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e5f1-28fc-4bdb-a6fb-a47bb2d9622e admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:23.955986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e5f1-28fc-4bdb-a6fb-a47bb2d9622e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:23.956332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e5f1-28fc-4bdb-a6fb-a47bb2d9622e admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:23.957120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4e5f1-28fc-4bdb-a6fb-a47bb2d9622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:23.959144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4e5f1-28fc-4bdb-a6fb-a47bb2d9622e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:23.986036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 218/438] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:17:23 2021] POST /identity/v3/users => generated 247 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:25.618199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1302fb-832b-413f-8624-d67777052a7c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:25.618888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1302fb-832b-413f-8624-d67777052a7c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:25.618888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1302fb-832b-413f-8624-d67777052a7c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:25.620785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 221/439] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:25.627633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ca0d-d836-4721-be5f-195468598013 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:25.628162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ca0d-d836-4721-be5f-195468598013 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:25.628162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ca0d-d836-4721-be5f-195468598013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:25.656508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-40a6ca0d-d836-4721-be5f-195468598013 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:25.658453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-40a6ca0d-d836-4721-be5f-195468598013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:25.666825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 219/440] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:25.691339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1302fb-832b-413f-8624-d67777052a7c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:25.711574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1302fb-832b-413f-8624-d67777052a7c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:25.718958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:25.719993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:25.720415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:25.720674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:25.739333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:25.746451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:25.748008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 222/441] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:25.755148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ca0d-d836-4721-be5f-195468598013 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:25.764654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ca0d-d836-4721-be5f-195468598013 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:25.775620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:25.776301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:25.776588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:25.776862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:25.777629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:25.777938 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:25.779593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:25.793274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 220/442] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:25.799934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:25.817072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f2b02-2a79-4092-aa3a-6bcbb6b30092 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:25.827070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:25.827924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:25.828226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:25.828502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:25.843039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:25.845035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:25.867138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:25.868585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 223/443] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:25.874772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:25.885133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb17fc-f7c9-4a5f-af15-5554886a3546 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:25.901906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:25.902583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:25.902863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:25.903137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:25.903895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:25.904204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:25.905827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:25.923459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 221/444] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:25.925457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:25.943034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376c0ae-bb3d-41a9-ac58-7d4522cbb5d6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:25.949002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:25.949987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:25.950278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:25.950544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:25.964604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:25.966641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:25.983513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:17:25.985108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 224/445] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:17:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:25.991572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.004642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d8c0e-e4c5-4a0c-af61-039aac41701e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.018683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.019433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.019726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.019988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.020842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.021148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.023084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.051612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 222/446] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:17:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.053020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.067083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721ab64-b3f4-42c5-bdf4-f090f4ea4cd0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.073066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.073907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.074186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.074510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.087225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.089203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.112452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:26.118844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 225/447] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.120245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.130582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873aa8-bdae-4313-8ac8-b35b71ccd4fe admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.138965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.139704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.139986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.140258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.141048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.141423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.143277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.161138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 223/448] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.167595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.178130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83be1e-048a-4690-9f21-82845e1af8f7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.188995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.189832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.190112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.190436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.202657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.204751 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.234245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:26.236273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 226/449] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.242912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.262029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db65d81-1bc3-4084-87c2-0689313dd6fa admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.266570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e68e5-88cd-47a8-befd-14ad969f074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.267377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e68e5-88cd-47a8-befd-14ad969f074c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.267680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e68e5-88cd-47a8-befd-14ad969f074c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.267960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e68e5-88cd-47a8-befd-14ad969f074c admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.268760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e68e5-88cd-47a8-befd-14ad969f074c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.269079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e68e5-88cd-47a8-befd-14ad969f074c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.270973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e68e5-88cd-47a8-befd-14ad969f074c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.297253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 224/450] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.304445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.323477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72c08-350e-45ab-b212-2de95d3b62fe admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.329587 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c695e32-6bae-4230-a5eb-f3178df7db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.330598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c695e32-6bae-4230-a5eb-f3178df7db9f admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.330963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c695e32-6bae-4230-a5eb-f3178df7db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.331241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c695e32-6bae-4230-a5eb-f3178df7db9f admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/068da11e10ca4a788bb08a42206ca42e/roles/fe4243b37e174c0c856029d03e170fac` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.346273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec981-77f5-403c-86fa-f6aacc37dcda None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.346616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec981-77f5-403c-86fa-f6aacc37dcda None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.346861 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec981-77f5-403c-86fa-f6aacc37dcda None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.349089 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 225/451] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:26.355923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69f25-f801-45dc-a64a-01b197163308 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.356233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69f25-f801-45dc-a64a-01b197163308 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.356474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b69f25-f801-45dc-a64a-01b197163308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.365617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c695e32-6bae-4230-a5eb-f3178df7db9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=068da11e10ca4a788bb08a42206ca42e, role_id=fe4243b37e174c0c856029d03e170fac)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.368330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c695e32-6bae-4230-a5eb-f3178df7db9f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.390825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-97b69f25-f801-45dc-a64a-01b197163308 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:26.399526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 227/452] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:26 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/068da11e10ca4a788bb08a42206ca42e/roles/fe4243b37e174c0c856029d03e170fac => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:26.400924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-97b69f25-f801-45dc-a64a-01b197163308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:26.417426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134f54-caf3-4384-a4c2-428b6d7d679e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.419568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134f54-caf3-4384-a4c2-428b6d7d679e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.419568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2134f54-caf3-4384-a4c2-428b6d7d679e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.420978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 228/453] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:26.429398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd4676-0c4b-4ca8-8c69-a87b34d0dcd0 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.429578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd4676-0c4b-4ca8-8c69-a87b34d0dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.429859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd4676-0c4b-4ca8-8c69-a87b34d0dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.465480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 226/454] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:26.467264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551c22d-6e12-4688-9bd4-62e53750e554 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.467797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551c22d-6e12-4688-9bd4-62e53750e554 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.468270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551c22d-6e12-4688-9bd4-62e53750e554 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.472196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 227/455] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:26.479425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d6dd4676-0c4b-4ca8-8c69-a87b34d0dcd0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:26.479425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d6dd4676-0c4b-4ca8-8c69-a87b34d0dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:26.482194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa5588-24ac-4871-83bc-52858ef3a555 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.482684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa5588-24ac-4871-83bc-52858ef3a555 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.483191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa5588-24ac-4871-83bc-52858ef3a555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.496842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 229/456] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 03:17:26.497803 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd4676-0c4b-4ca8-8c69-a87b34d0dcd0 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.505837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-80aa5588-24ac-4871-83bc-52858ef3a555 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:26.507548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-80aa5588-24ac-4871-83bc-52858ef3a555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:26.509247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd4676-0c4b-4ca8-8c69-a87b34d0dcd0 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.514186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.515019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.515295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.515624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.518463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 228/457] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:26.528299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:26.532281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa5588-24ac-4871-83bc-52858ef3a555 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.536053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:26.537318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 230/458] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.543967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.549296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa5588-24ac-4871-83bc-52858ef3a555 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.555872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c766-5938-420c-ba4f-84aff0405f97 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.559782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.560965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.561234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.561641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.561913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.562157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.562445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.563523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.563732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.564141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.567175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.581897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:26.582562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 231/459] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.587477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.590999 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:26.592697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 229/460] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:26.595340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.601280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41c36c-ef12-41e0-b8c5-f0cfe7b5f781 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.606625 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5390-b092-497a-ae92-7c48e03d754f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.606771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.607572 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.607851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.608150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.612560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.613714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.614232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.614689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.621373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:26.627943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:26.629333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 232/461] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.629965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.630080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.632101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.639811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84adc0-d142-46f1-9da2-b1c49fdc7e45 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.648983 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.649759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.650043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.650309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.651165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.651554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.652835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:26.653219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.654222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 230/462] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.654848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.663688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 233/463] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.666752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.670103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59fdcf-990a-4a31-86fb-fc93064af3c0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.675570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.676291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.676573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.676851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.677039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9900b-06e7-4c62-8472-34f4b5ba2282 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.677657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.678063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.679914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.681681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.682689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.683274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.683580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.684296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.684598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.686678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.689933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 231/464] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.690817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.700613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2dc13-5a3b-445e-af06-ed57b8dbaf74 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.701291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 234/465] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.702242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.710607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.711466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.711751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.712028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.712933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52a4ce-39cc-486f-b74f-4d6d3771a49c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.717900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.718681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.718959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.719549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.723582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.725577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.732281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.734953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.743423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:26.744648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 232/466] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.745473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.753305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:26.755156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 235/467] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.756059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.756649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa7f85-1e76-464e-939a-58c116970757 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.761519 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.762379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.762663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.762988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.767425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407af0b-cde6-4a4f-b233-6a428ae3ad13 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.771986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.772217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.772881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.773160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.773431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.774156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.774326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.774543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.776520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.790980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 236/468] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.792094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.793377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:17:26.794335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 233/469] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.800670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.803111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d2c5-82ae-4fc1-b68b-fab34bbcfff2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.809132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.809919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.810198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.810471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.810713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a597f-1468-4ca4-9a4a-e1fd9063d2d0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.811246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.811585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.813491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.815745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.816629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.817032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.817377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.826034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.826935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 237/470] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.827929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.829087 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.839072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf6a2c-a7a3-4746-a8da-4b139898f700 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.843572 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.844315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.844650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.844927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.845767 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.845894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 03:17:26.846129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.847154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:26.847154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:26.847154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:26.847525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 234/471] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.848379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.848788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.859461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cfbb8-1e60-4df6-8c7d-0fd149c44252 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.869399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.870430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.870755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.871072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.883192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.885462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.891541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 238/472] 10.222.0.58 () {56 vars in 1159 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.897293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.900899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 03:17:26.902379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 235/473] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/users/glance => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.903462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.908041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cddb4-075e-4c9b-8089-530bb04ca2db admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.913019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.913784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.914183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.914525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.914664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b3427-d844-4562-b0d8-21501a0f717e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.915628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.916018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.918088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.918949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.919756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.920200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.920483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.933556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.936105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.937356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 239/474] 10.222.0.58 () {56 vars in 1161 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.938430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.949212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b292bb-aa42-459e-98c5-ad31fd3aacae admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.954247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.955177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.955557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.955943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.956312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:26.956957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:26.957377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.957542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 236/475] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:26.958381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.960435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:26.973233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4c3b-2a15-4346-9a9c-8d2c53519b12 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.978908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:26.979718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:26.979995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:26.980807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:26.984601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 240/476] 10.222.0.58 () {56 vars in 1159 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:26.985398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:26.994190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:26.995422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d521d-80cb-45d5-9360-25fc8e4d045b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:26.996204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.000167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.001091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.001697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.002096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.002866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.003185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.004894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.016845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:27.018550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 237/478] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:27.019564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.023045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 241/478] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.028671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.033187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdce562-6b70-4f14-8ddd-8d765dfb115b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.039069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.039773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db54351-670e-4526-9c0c-b00972b28cb1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.040124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.040474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.040824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.045131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.045864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.046148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.046422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.047309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.047729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.050050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.054160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.056156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.064376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 242/479] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.065333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.074953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229090c-579a-470c-beae-fc05ec32c938 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.076497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:27.078296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 238/480] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:27.079258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.079965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.080910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.081192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.081468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.089291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.090352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae1d7e-1e06-44c1-8056-edab0ee9b5fa admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.091389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.095696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34624e3-4c7c-4738-88d5-15793dbe4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.096487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34624e3-4c7c-4738-88d5-15793dbe4512 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.096768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34624e3-4c7c-4738-88d5-15793dbe4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.097042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34624e3-4c7c-4738-88d5-15793dbe4512 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.104445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34624e3-4c7c-4738-88d5-15793dbe4512 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.106182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:27.106520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34624e3-4c7c-4738-88d5-15793dbe4512 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.107736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 243/481] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:27.108442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.119032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9522a2-d041-4609-997f-6d921601b0a7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.120002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-b34624e3-4c7c-4738-88d5-15793dbe4512 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:27.121373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 239/482] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:27.122577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c8d25-d057-41c1-bd3a-6e0289d13e4c None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.123874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c8d25-d057-41c1-bd3a-6e0289d13e4c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.123874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c8d25-d057-41c1-bd3a-6e0289d13e4c None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.124490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.124994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 240/483] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:27.125176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.125484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.125773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c8d25-d057-41c1-bd3a-6e0289d13e4c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.125910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.126836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.127221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.129167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.143374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c8d25-d057-41c1-bd3a-6e0289d13e4c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.143540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 244/484] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.143540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.151042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf6f7d-b119-46df-9434-e2a7b5f2489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.151742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6f7d-b119-46df-9434-e2a7b5f2489c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.152020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6f7d-b119-46df-9434-e2a7b5f2489c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.152289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf6f7d-b119-46df-9434-e2a7b5f2489c admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.153072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf6f7d-b119-46df-9434-e2a7b5f2489c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.153377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf6f7d-b119-46df-9434-e2a7b5f2489c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.155244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf6f7d-b119-46df-9434-e2a7b5f2489c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.156027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec1f7-8874-4a55-b4fe-dde77c014306 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.160701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.161340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.161621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.161896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.162675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.162983 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.164878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.167142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 241/485] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.168458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ee64-deeb-485c-8a09-7bee8680379d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.168803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ee64-deeb-485c-8a09-7bee8680379d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.169080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ee64-deeb-485c-8a09-7bee8680379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.178176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 245/486] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.179221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.192375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535561b3-805d-42f0-9f72-0d062dc3c005 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.193588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3ad5ee64-deeb-485c-8a09-7bee8680379d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:27.194945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3ad5ee64-deeb-485c-8a09-7bee8680379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:27.196755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.197520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.197825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.198100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.202933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 242/487] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:27.203911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ee64-deeb-485c-8a09-7bee8680379d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.213097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ee64-deeb-485c-8a09-7bee8680379d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.214212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.216574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.217443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.218314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.218584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.218845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/d5d8aa6c0fa94ced8f7b277572b06dc0/roles/fe4243b37e174c0c856029d03e170fac` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.234319 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=d5d8aa6c0fa94ced8f7b277572b06dc0, role_id=fe4243b37e174c0c856029d03e170fac)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.237280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:27.237410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.238685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 246/488] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:27.239257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.250323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea917-d3cf-4425-824d-431aae7a886f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.254811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 243/489] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:27 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/d5d8aa6c0fa94ced8f7b277572b06dc0/roles/fe4243b37e174c0c856029d03e170fac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:27.256197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.312721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.313888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.314169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.314605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/3357ca71ec4443f8a9fba9b7ac4cfdd0/roles/fe4243b37e174c0c856029d03e170fac` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.331280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=3357ca71ec4443f8a9fba9b7ac4cfdd0, role_id=fe4243b37e174c0c856029d03e170fac)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.334031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.344862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728cb9a-81d4-4f4d-b4b5-bdc44a445825 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.359380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 247/490] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:27 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/3357ca71ec4443f8a9fba9b7ac4cfdd0/roles/fe4243b37e174c0c856029d03e170fac => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:27.359380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.464359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dbe5d-01b0-4c8a-a9de-7a61989060b3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.472551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.473218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.473495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.473768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.474568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.474877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.476813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.480989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.482188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.482695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.483181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.496880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 248/491] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.500860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.502510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:27.509476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:27.510926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 244/492] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:27.518964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53188d-63a3-448a-80f3-54bc724d4ee5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.519306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.529261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9e0a9-ca12-40db-90dd-aaf9e0f97802 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.535456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.536373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.536653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.536919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/b43f60d8ae5f4e8cb3ba57f76777ac84/roles/fe4243b37e174c0c856029d03e170fac` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.538050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.538711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.538980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.539245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.540047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.540347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.541984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.566660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 245/493] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:27.573015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=b43f60d8ae5f4e8cb3ba57f76777ac84, role_id=fe4243b37e174c0c856029d03e170fac)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.573534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.575917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.587311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356ab3-4099-4521-8a78-fe43c5e62b70 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.597298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 249/494] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:27 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/b43f60d8ae5f4e8cb3ba57f76777ac84/roles/fe4243b37e174c0c856029d03e170fac => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:27.657934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.658741 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.659018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.659289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.670914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.673061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.692450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:27.694049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 246/495] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:27.700624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.711748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068db93-cab5-4a50-a86c-029e56fbea53 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.716770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.717462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.717787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.718060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.718788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.719145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.720983 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.734090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 250/496] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.740898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.752644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9aeae-bc10-41c9-9d70-83b7ee951aa7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.759158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.760066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.760344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.760613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.772318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.774608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.792370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:17:27.793909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 247/497] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:27.800114 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.810503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476af7-eb91-4def-9398-fbc65ae58bfd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.816312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.816992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.817275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.817595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.818539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.818845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.821727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.842216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 251/498] 10.222.0.58 () {56 vars in 1157 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:27.848843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.860609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4545-11e7-452e-a3b2-31fc0b37b9c8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.865169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.865866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.866143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.866464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.875172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.877132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.886497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 248/499] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:27.893295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.903677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796958-d8e6-43cb-863d-2a8c2d02d739 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.908300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.909172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.909494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.909769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.920668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.922588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.941758 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:27.943218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 252/500] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:27.954630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:27.962825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f8ddf-e86c-4a4e-975d-cc7e3dac9f26 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:27.971776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:27.972795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:27.973293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:27.973761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:27.974691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:27.975192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:27.977124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:27.991505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 249/501] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:27.997853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:28.011583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f03699-f265-4bb9-9a1c-a90470bcd10a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:28.019036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:28.019947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:28.020279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:28.020591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:28.030344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:28.032466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:28.045648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:28.047103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 253/502] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:28.053526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:28.063920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604771d7-7845-4091-ae53-3e888fc64571 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:28.068626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cbd2b-7277-496e-b10e-2476b4af22de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:28.069327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbd2b-7277-496e-b10e-2476b4af22de admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:28.069600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbd2b-7277-496e-b10e-2476b4af22de admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:28.069918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cbd2b-7277-496e-b10e-2476b4af22de admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:28.070698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cbd2b-7277-496e-b10e-2476b4af22de admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:28.070998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cbd2b-7277-496e-b10e-2476b4af22de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:28.072985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cbd2b-7277-496e-b10e-2476b4af22de admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:28.091758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 250/503] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:28.098433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:28.108998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc86446-3e25-48a6-8230-b224578b8729 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:28.113642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6c678-cde3-48e9-a2b3-3da2b3059706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:28.114320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c678-cde3-48e9-a2b3-3da2b3059706 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:28.114599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c678-cde3-48e9-a2b3-3da2b3059706 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:28.114866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c678-cde3-48e9-a2b3-3da2b3059706 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:28.115750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c678-cde3-48e9-a2b3-3da2b3059706 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=f9170b262488467fad0bf6aad8d3814a) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:28.116049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c678-cde3-48e9-a2b3-3da2b3059706 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:28.117962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c678-cde3-48e9-a2b3-3da2b3059706 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:28.123844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 254/504] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:28 2021] GET /identity/v3/role_assignments?user.id=f9170b262488467fad0bf6aad8d3814a&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:28.995004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdef5d-d5df-4e50-a7c7-8dba3b41e5ba None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:28.995567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdef5d-d5df-4e50-a7c7-8dba3b41e5ba None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:28.995567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdef5d-d5df-4e50-a7c7-8dba3b41e5ba None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:28.997562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 251/505] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:29.003961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e66c-c7ed-48f4-bc08-c2020b142671 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.004366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e66c-c7ed-48f4-bc08-c2020b142671 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.004533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372e66c-c7ed-48f4-bc08-c2020b142671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.022645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7372e66c-c7ed-48f4-bc08-c2020b142671 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:29.023868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7372e66c-c7ed-48f4-bc08-c2020b142671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:29.031644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 255/506] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:29.055772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdef5d-d5df-4e50-a7c7-8dba3b41e5ba None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.068522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdef5d-d5df-4e50-a7c7-8dba3b41e5ba None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.072808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.073596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.073873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.074137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.093511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:29.100277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:29.101764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 252/507] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:29.108346 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372e66c-c7ed-48f4-bc08-c2020b142671 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.117594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372e66c-c7ed-48f4-bc08-c2020b142671 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.122020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.122678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.122954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.123222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.123992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:29.124290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.126188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.134934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 256/508] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:29.140961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.153005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae196d2-2db4-49d4-930f-87a1277dc149 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.162884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.163711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.163994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.164262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.179131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.181042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.198382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:29.199968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 253/509] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:29.206538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.220445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbd8d-5250-4e06-80f4-8067b6034ebb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.228809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.229482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.229757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.230027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.230809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:29.231113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.232783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.247107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 257/510] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:29.253627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.263745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00b295-2dc5-40fe-bc2c-c366e8c4ab17 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.268767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.269583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.269858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.270127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.279110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.281235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.295215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:17:29.296735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 254/511] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:29.302943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.313390 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2df02-617b-44d1-9b91-816e6d88c0d9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.318035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.318793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.319071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.319340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.320202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:29.320503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.322397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.341090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 258/512] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:29.347536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.361133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13256e-5e96-45fc-8401-7b77a350571c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.365805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.366533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.366775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.367043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.376458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.378335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.393799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 255/513] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:29.402116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.413547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7791a-7542-44af-8342-51fdba5cda21 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.420350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.421235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.421510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.421820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.436116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.438013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.459657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:29.460869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 259/514] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:29.467214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.479961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8d5b4-c8da-4739-9afe-7e6359272e8d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.488366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.489031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.489306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.489572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.490356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:29.490657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.492342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.512669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 256/515] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:29.519551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.531405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a30c-a47b-49f3-b47f-0f57fd6c8756 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.536864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.537725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.538012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.538283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.548998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.551098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.568363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:29.569967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 260/516] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:29.576279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.588562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98ef5-9e63-46bc-b274-07495c6d514e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.593415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206523f-b8f9-41d9-bf1f-20af3c07d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.594087 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206523f-b8f9-41d9-bf1f-20af3c07d170 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.594804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206523f-b8f9-41d9-bf1f-20af3c07d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.595088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206523f-b8f9-41d9-bf1f-20af3c07d170 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.596038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206523f-b8f9-41d9-bf1f-20af3c07d170 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:29.596350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206523f-b8f9-41d9-bf1f-20af3c07d170 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.598264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206523f-b8f9-41d9-bf1f-20af3c07d170 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.617221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 257/517] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:29.624226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:29.637851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23848d2e-2562-497e-aa5e-4214c8b4fdb4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:29.648950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706357c-64d6-408c-9365-fa137c89edae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:29.649791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706357c-64d6-408c-9365-fa137c89edae admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.650066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706357c-64d6-408c-9365-fa137c89edae admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.650335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706357c-64d6-408c-9365-fa137c89edae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.651214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706357c-64d6-408c-9365-fa137c89edae admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=068da11e10ca4a788bb08a42206ca42e) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:29.651544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706357c-64d6-408c-9365-fa137c89edae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:29.653455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706357c-64d6-408c-9365-fa137c89edae admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:29.665209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 261/518] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:29 2021] GET /identity/v3/role_assignments?user.id=068da11e10ca4a788bb08a42206ca42e&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:29.974766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408481a-5a6c-48ea-bad3-9b50e4e271d2 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.975162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408481a-5a6c-48ea-bad3-9b50e4e271d2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.975333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408481a-5a6c-48ea-bad3-9b50e4e271d2 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:29.977345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 258/519] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:29.983536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb0e3-6733-4dc1-8a2f-e930db6278c4 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:29.983825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb0e3-6733-4dc1-8a2f-e930db6278c4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:29.984101 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb0e3-6733-4dc1-8a2f-e930db6278c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.003765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d82fb0e3-6733-4dc1-8a2f-e930db6278c4 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:30.004957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d82fb0e3-6733-4dc1-8a2f-e930db6278c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:30.012959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 262/520] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:30.037161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408481a-5a6c-48ea-bad3-9b50e4e271d2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.049819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408481a-5a6c-48ea-bad3-9b50e4e271d2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.054262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.055074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.055390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.055650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.067869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:30.074695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:30.076229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 259/521] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:30.082886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb0e3-6733-4dc1-8a2f-e930db6278c4 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.091980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb0e3-6733-4dc1-8a2f-e930db6278c4 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.096665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.097391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.097666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.097930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.098743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.099046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.100707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.109774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 263/522] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.115928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.126836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69731214-b2db-49ce-88da-60b4c598f3ef admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.131587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.132440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.132716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.133214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.146426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.148454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.167588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:30.169243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 260/523] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:30.175670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.186262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09364-f2a1-4983-bba8-3c855eb50a7a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.191016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699d6a7-7afe-41f1-8879-407631a90ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.191766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699d6a7-7afe-41f1-8879-407631a90ecf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.192047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699d6a7-7afe-41f1-8879-407631a90ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.192323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699d6a7-7afe-41f1-8879-407631a90ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.193045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699d6a7-7afe-41f1-8879-407631a90ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.193405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699d6a7-7afe-41f1-8879-407631a90ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.195041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699d6a7-7afe-41f1-8879-407631a90ecf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.208731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 264/524] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.214886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.225154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058591-1564-4ea9-9fb4-88f327aa42c9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.229647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.230491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.230766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.231031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.239101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.241210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.244270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444d25-23d0-42ef-b50d-3bcf016e2ca4 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.244550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444d25-23d0-42ef-b50d-3bcf016e2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.244822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444d25-23d0-42ef-b50d-3bcf016e2ca4 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.246826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 265/525] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:30.252755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6de7-7b93-4b71-ab6e-abf9a345e017 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.253034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6de7-7b93-4b71-ab6e-abf9a345e017 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.253306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6de7-7b93-4b71-ab6e-abf9a345e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.258845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:17:30.261527 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 261/526] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:30.275376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.275630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-895d6de7-7b93-4b71-ab6e-abf9a345e017 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:30.275630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-895d6de7-7b93-4b71-ab6e-abf9a345e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:30.285198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 266/527] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:30.286772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a6de8-02e0-4984-b4c6-2b868f993567 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.291531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.292458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.292904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.293349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.294423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.294880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.297035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.311393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6de7-7b93-4b71-ab6e-abf9a345e017 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.325778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6de7-7b93-4b71-ab6e-abf9a345e017 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.331376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 262/528] 10.222.0.58 () {56 vars in 1159 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:30.334553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.335553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.335993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.336408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.343342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.351164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:30.359909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:30.360078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5e08f-b08f-4862-ac14-04fcb1a145a0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.362178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 267/529] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:30.373972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.382837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.383782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.384276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.384626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.386830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813446-461c-4773-8067-73eeb083c500 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.396264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.397678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.398639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.399081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.399597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.400547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.401081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.403044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.403897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.416865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 263/530] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:17:30.418276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 268/531] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:30.426187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.427618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.434257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b50ef-279b-49d8-aac5-e5f88834edf9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.440218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.441060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.441339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.441609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.453728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.455518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a6de1-b82c-41d2-bcad-4b87fce1230f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.456429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.474721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:30.476326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 264/532] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:30.482615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.483173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.485603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.486294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.487044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.503369 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabef33e-f0ec-4382-acb6-39278306efa9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.505577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.507514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.508864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1f0d3-c51c-410f-8449-fa8c0014d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.509805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f0d3-c51c-410f-8449-fa8c0014d051 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.510492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f0d3-c51c-410f-8449-fa8c0014d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.510912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f0d3-c51c-410f-8449-fa8c0014d051 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.511799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1f0d3-c51c-410f-8449-fa8c0014d051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.512172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1f0d3-c51c-410f-8449-fa8c0014d051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.513892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1f0d3-c51c-410f-8449-fa8c0014d051 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.525388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:30.528399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 265/534] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.529742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1de01-def9-4d31-949c-e45759e8a696 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.530083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1de01-def9-4d31-949c-e45759e8a696 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.530372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1de01-def9-4d31-949c-e45759e8a696 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.531660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 269/534] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:30.532734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 266/535] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:30.537403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.541249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1de01-def9-4d31-949c-e45759e8a696 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.550897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0d8a4-b00c-40fa-840f-606d75a39c2d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.554090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1de01-def9-4d31-949c-e45759e8a696 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.556607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07ce49-e958-4fdb-9c32-3bdbe875346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.557492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07ce49-e958-4fdb-9c32-3bdbe875346d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.558271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07ce49-e958-4fdb-9c32-3bdbe875346d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.558722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07ce49-e958-4fdb-9c32-3bdbe875346d admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.559236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.559856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07ce49-e958-4fdb-9c32-3bdbe875346d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.560193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.560531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.560709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07ce49-e958-4fdb-9c32-3bdbe875346d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.560984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.564196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07ce49-e958-4fdb-9c32-3bdbe875346d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.569833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.572007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.584220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 270/536] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.584220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf02ef-f671-4a2f-a1ec-e25681f77cf2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.584220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf02ef-f671-4a2f-a1ec-e25681f77cf2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.584220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf02ef-f671-4a2f-a1ec-e25681f77cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.590695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:30.592179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 267/537] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:30.592943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.607517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a4cf02ef-f671-4a2f-a1ec-e25681f77cf2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:30.607926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559de88-1078-43db-9939-45fd408d1721 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.609294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a4cf02ef-f671-4a2f-a1ec-e25681f77cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:30.612819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.613650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.613926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.614247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.621426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 271/538] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:30.622469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf02ef-f671-4a2f-a1ec-e25681f77cf2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.628581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.630779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.633219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf02ef-f671-4a2f-a1ec-e25681f77cf2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.639085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.640013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.640497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.640967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.642257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.642770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.644994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.655215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 03:17:30.656819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 268/539] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/users/neutron => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:30.663297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 272/540] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.664281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.666968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.675927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814534c-0eab-44a6-931c-16843f3ab8c4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.681367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.682025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.682231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bc1eb-ec0f-4819-989b-e047f60f7f00 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.682333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.682606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.683837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.684194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.686143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.688602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.690473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.690972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.691496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.704732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:30.705032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 269/541] 10.222.0.58 () {56 vars in 1161 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.705927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.713512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:30.715833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 273/542] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:30.716586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6158-b7ac-4450-949b-e09cf38a2921 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.717168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.728411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.729044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.729323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.729595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.730192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1910c-a5e7-4e94-b4f8-2092a45fa112 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.730496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=d5d8aa6c0fa94ced8f7b277572b06dc0) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.730808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.732887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.736865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.738187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.738674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.739150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.740384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 270/543] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/role_assignments?user.id=d5d8aa6c0fa94ced8f7b277572b06dc0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.741394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.749718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.752596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.753221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39ef08-27c4-4930-a36c-9f7b2e318398 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.758178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.758909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.759185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.760167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.761001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.761353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.763448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.765290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 274/544] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:30.773336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.775959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 271/545] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.782381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.790991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcaec6-f9ee-4d15-9fb3-034c5367fca1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.795307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3be2d8-85ea-401b-9e26-1fdc5f068d54 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.799944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d5e23-44f8-4369-bfa2-91bd8d9a21ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.800263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7a4a3-4d45-4f5f-a5ce-8f31f468544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.800805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5e23-44f8-4369-bfa2-91bd8d9a21ea admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.800987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7a4a3-4d45-4f5f-a5ce-8f31f468544b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.801081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5e23-44f8-4369-bfa2-91bd8d9a21ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.801268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7a4a3-4d45-4f5f-a5ce-8f31f468544b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.801373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5e23-44f8-4369-bfa2-91bd8d9a21ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.801539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7a4a3-4d45-4f5f-a5ce-8f31f468544b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.813231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7a4a3-4d45-4f5f-a5ce-8f31f468544b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.815216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7a4a3-4d45-4f5f-a5ce-8f31f468544b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.815505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d5e23-44f8-4369-bfa2-91bd8d9a21ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.817648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d5e23-44f8-4369-bfa2-91bd8d9a21ea admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.835910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-a9b7a4a3-4d45-4f5f-a5ce-8f31f468544b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:30.837166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 275/546] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:30.838493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c093b-2090-49a2-a34d-20f46fba3cf6 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.838771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c093b-2090-49a2-a34d-20f46fba3cf6 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.839044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c093b-2090-49a2-a34d-20f46fba3cf6 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.839626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-bc4d5e23-44f8-4369-bfa2-91bd8d9a21ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:30.840728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 276/547] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:30.841315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 272/548] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:30.846842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c093b-2090-49a2-a34d-20f46fba3cf6 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.847398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3df8-4292-4ba8-9cb1-b73d575827d1 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.847691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3df8-4292-4ba8-9cb1-b73d575827d1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.847965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a3df8-4292-4ba8-9cb1-b73d575827d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.859524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c093b-2090-49a2-a34d-20f46fba3cf6 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.864510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.865288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.865565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.865835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.866896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.867242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.868975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.869120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-df3a3df8-4292-4ba8-9cb1-b73d575827d1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:30.870191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-df3a3df8-4292-4ba8-9cb1-b73d575827d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:30.881078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 273/549] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:30.881950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a3df8-4292-4ba8-9cb1-b73d575827d1 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.888819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 277/550] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.892632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a3df8-4292-4ba8-9cb1-b73d575827d1 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.895236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.897559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.898228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.898502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.898844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.899612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.899914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.901808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.913129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f9f40-5c06-4c82-8f2b-8abb99f4c581 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.915618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 274/551] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:30.921884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.926242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.927064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.927366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.927653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.937746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4244b-3c20-4660-81b4-7a2277e65c49 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.940988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.943228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.943696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.944306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.944776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.945138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.957737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:30.960011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:30.961681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 278/552] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:30.962584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.965336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:30.966957 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 275/553] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:30.972282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:30.975111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfa5a-8f0e-4946-9e0f-353fd54c4a1c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.979486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.980218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.980494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.980763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.984221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff79fff-d08e-4056-b494-067e638dd629 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:30.989663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.990618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:30.991284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:30.991599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:30.991696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:30.991882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:30.992710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:30.993023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:30.995657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.005813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 03:17:31.007328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 279/554] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/users/glance => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:31.013366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 276/555] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:31.013526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.014446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.024728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff16d6-57c7-4624-a355-9f1e40f13a68 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.028275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2f9f-fc0a-47fc-9fab-90056a3f2ffc admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.030013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.030687 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.030963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.031233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.032099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.032398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.033848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.033995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.034522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.034807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.035085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.036202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.036514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.038371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.044234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 280/556] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:31.044800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.061125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d407bb-9b55-454c-9f8e-ebddfa04604e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.069582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 277/557] 10.222.0.58 () {56 vars in 1159 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:31.069582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.074363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.075575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.076669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.077449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.078640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=3357ca71ec4443f8a9fba9b7ac4cfdd0) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.079127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.080085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dead0-20c2-4a20-8d1d-3edf095a95dc admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.081690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.086559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.087391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.087678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.087949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.091834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 281/558] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/role_assignments?user.id=3357ca71ec4443f8a9fba9b7ac4cfdd0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:31.092905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.105232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17194ffd-08e9-49e3-be3e-23f302f68623 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.111033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.112191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.112854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.113368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.116605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.118479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.131697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.137686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.158150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 282/559] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:31.159847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:31.161657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 278/560] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:31.168180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.173912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.184434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9c7e-000d-4b78-876a-c033ba43e789 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.195001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cf0dc-e25a-4d00-a7e8-c41cffbab1df admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.196059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.197952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.198544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.199934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.206484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.209224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.210349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.210855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.212901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.215163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.217306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.230099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.232404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.241195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 279/561] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:31.256883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.268081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:31.269400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f4ac-b10a-4341-95f0-e8e5b7a4acc8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.272119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 283/562] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:31.275838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.277340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.278275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.278537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.278802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.293929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c9b1e-b165-45fd-b72e-63552eeec493 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.294231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.296957 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.302819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.304786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.305387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.305852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.306850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.307330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.309555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.313015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:17:31.314504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 280/563] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:31.321279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.325484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 284/564] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:31.333293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.333494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8577c0-d7eb-4459-8d71-c773be5e82e4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.337901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.338569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.338847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.339116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.339986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.340451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.347417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.350987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f219c29-890c-43fd-a9b8-504eb51d256b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.364027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 281/565] 10.222.0.58 () {56 vars in 1157 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:31.365142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.365961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.366247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.366521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.373086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.384934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.386962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de6dcf-99ac-4e8d-aec5-5f55ab269788 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.387535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.395716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.396412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.396412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.396562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.405523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:31.413294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 285/566] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:31.413427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.415090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.415285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.426361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83707a4c-5fcd-4c95-8cf0-192d1278e5b9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.432054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.433293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.433777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.434251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.435095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:31.435504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.436025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.437085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 282/567] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:31.440956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.444491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.452944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 286/568] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:31.458190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ec011-b2f1-4aba-b0ce-be868a2ce31f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.460475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.463888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.464803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.465243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.465696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.466570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.467286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.469744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.473012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b5ed-6b3a-43ed-988a-eb5303b9760a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.478753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.479605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.480211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.480335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.481265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=b43f60d8ae5f4e8cb3ba57f76777ac84) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.481646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.483691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.484010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 283/569] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:31.491477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.499617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 287/570] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/role_assignments?user.id=b43f60d8ae5f4e8cb3ba57f76777ac84&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:31.503465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075cfb-945a-4382-a52c-d37e5bc00e6c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.508503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.509644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.510115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.510595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.519118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.521526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.536729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:31.538665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 284/571] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:31.545288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.555958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f2992-058c-4961-a2a6-af05d2bd8c67 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.561300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d1199-dd00-43bb-995b-3589485beff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.562327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1199-dd00-43bb-995b-3589485beff4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.562851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1199-dd00-43bb-995b-3589485beff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.563554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d1199-dd00-43bb-995b-3589485beff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.564629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1199-dd00-43bb-995b-3589485beff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:31.565137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1199-dd00-43bb-995b-3589485beff4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.567307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d1199-dd00-43bb-995b-3589485beff4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.581035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 288/572] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:31.587872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:31.603396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a3be-de61-4c85-ab9a-4c80d3bef124 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:31.608663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54424d-4485-4d41-8a21-717caa6a982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:31.610564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54424d-4485-4d41-8a21-717caa6a982e admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:31.611214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54424d-4485-4d41-8a21-717caa6a982e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:31.611727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54424d-4485-4d41-8a21-717caa6a982e admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/f9170b262488467fad0bf6aad8d3814a/roles/fe4243b37e174c0c856029d03e170fac` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:31.635155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54424d-4485-4d41-8a21-717caa6a982e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=f9170b262488467fad0bf6aad8d3814a, role_id=fe4243b37e174c0c856029d03e170fac)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:31.638332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54424d-4485-4d41-8a21-717caa6a982e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:31.658417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 285/573] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:31 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/f9170b262488467fad0bf6aad8d3814a/roles/fe4243b37e174c0c856029d03e170fac => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:32.596324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025bc2b-c793-455d-9fcd-dcb92f13ff85 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:32.596847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025bc2b-c793-455d-9fcd-dcb92f13ff85 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:32.596922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025bc2b-c793-455d-9fcd-dcb92f13ff85 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:32.598890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 289/574] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:32.605139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4614b0-0049-4843-add5-4fd2bf0b0cef None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:32.605566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4614b0-0049-4843-add5-4fd2bf0b0cef None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:32.605738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4614b0-0049-4843-add5-4fd2bf0b0cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:32.636370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2d4614b0-0049-4843-add5-4fd2bf0b0cef None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:32.637600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2d4614b0-0049-4843-add5-4fd2bf0b0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:32.714165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 286/575] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:32.755227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025bc2b-c793-455d-9fcd-dcb92f13ff85 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:32.773272 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025bc2b-c793-455d-9fcd-dcb92f13ff85 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:32.777634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:32.778424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:32.778705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:32.778973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:32.790581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:32.798387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:32.799996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 290/576] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:32.809105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4614b0-0049-4843-add5-4fd2bf0b0cef None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:32.822980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4614b0-0049-4843-add5-4fd2bf0b0cef None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:32.828755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:32.829455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:32.829737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:32.830008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:32.830782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:32.831096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:32.832802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:32.847868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 287/577] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:32.853852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:32.866962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd2645-56b9-486b-abde-995ff0bee5ae admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:32.874462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:32.875272 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:32.877360 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:32.877673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:32.897505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:32.899388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:32.917131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:32.918675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 291/578] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:32.924793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:32.941739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e97b3-8cac-4745-988e-5f474274e31d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:32.950083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:32.950761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:32.951040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:32.951314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:32.952074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:32.952380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:32.954213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:32.975478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 288/579] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:32.981265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:32.999837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed82181-82ba-404f-a581-a5be6e9f289a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.011633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.012781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.013253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.013804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.028081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.030121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.055240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:17:33.056901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 292/580] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:17:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:33.063272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.076467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5840d-7406-4721-bc62-d5bb280f3945 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.087048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.087771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.088054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.088331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.089186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:33.089493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.091369 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.119136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 289/581] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:33.125237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.140347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c28383-fbe8-4670-855c-b3742af4d3ed admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.147402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.148054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.148337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.148609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.163062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.164859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.177258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 293/582] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:33.183638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.197067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c2f93-99c2-4852-961e-14da8f6f48f7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.207684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc335c-30b3-45cf-8be0-5ac92433a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.208504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc335c-30b3-45cf-8be0-5ac92433a37e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.208786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc335c-30b3-45cf-8be0-5ac92433a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.209061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc335c-30b3-45cf-8be0-5ac92433a37e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.223678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc335c-30b3-45cf-8be0-5ac92433a37e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.225637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc335c-30b3-45cf-8be0-5ac92433a37e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.251892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-abbc335c-30b3-45cf-8be0-5ac92433a37e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:33.257824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 290/583] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:33.259087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.277785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc9354-19ed-4967-b875-f4f6f2275c37 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.293980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.294656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.294937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.295214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.295650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4da5eb-c0d0-4e4f-8166-5735a3d2887f None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.296026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:33.296338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.296903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4da5eb-c0d0-4e4f-8166-5735a3d2887f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.297579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4da5eb-c0d0-4e4f-8166-5735a3d2887f None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.297987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.301319 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 291/584] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:33 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:33.307524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2959-5fe9-4c9a-a94b-12579cee6b96 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.308327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2959-5fe9-4c9a-a94b-12579cee6b96 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.309390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2959-5fe9-4c9a-a94b-12579cee6b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.322293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 294/585] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:33.329685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.346519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99fa3-7097-4c0d-b51c-0403d599c4e7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.351876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8a5b2959-5fe9-4c9a-a94b-12579cee6b96 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:33.353082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8a5b2959-5fe9-4c9a-a94b-12579cee6b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:33.359547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.360381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.360663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.360946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.371077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.373062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.374713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 292/586] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:33.396847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:33.398057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 295/587] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:33.404584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b2959-5fe9-4c9a-a94b-12579cee6b96 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.411581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.417389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b2959-5fe9-4c9a-a94b-12579cee6b96 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.427214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.427908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.428185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.428451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.429240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:33.429545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.431430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.435326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67489c-ea5b-4e85-a3af-3ddba3aae377 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.440956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.441774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.442052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.442325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.442986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.444060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:33.444060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:33.444060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:33.445147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.458947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 03:17:33.460492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 296/588] 10.222.0.58 () {56 vars in 1151 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:33.461567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 293/589] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:33.468343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.472475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.482429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784df71f-7aeb-4ffb-b145-60225e068f6e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.491801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906b689-9fc0-4bf9-b9a7-a40884727ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.492509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b689-9fc0-4bf9-b9a7-a40884727ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.492788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b689-9fc0-4bf9-b9a7-a40884727ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.493086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d42ea2-fef0-42a7-a58e-290ed31658e3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.494252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b689-9fc0-4bf9-b9a7-a40884727ea0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.495100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906b689-9fc0-4bf9-b9a7-a40884727ea0 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=068da11e10ca4a788bb08a42206ca42e) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:33.495460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906b689-9fc0-4bf9-b9a7-a40884727ea0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.500679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906b689-9fc0-4bf9-b9a7-a40884727ea0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.502167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.503427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.503776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.504058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.504799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:33.505109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.506157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:33.506157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:33.506157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:33.507045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.515894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 294/590] 10.222.0.58 () {56 vars in 1146 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:33.516399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 297/591] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/role_assignments?user.id=068da11e10ca4a788bb08a42206ca42e&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:33.523338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:33.537252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b0052-9dc6-4063-b9b9-296b3468735a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:33.544053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a3ce-5fb1-4e7d-b40f-a5478a85b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:33.544789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a3ce-5fb1-4e7d-b40f-a5478a85b1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.545067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a3ce-5fb1-4e7d-b40f-a5478a85b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.545342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a3ce-5fb1-4e7d-b40f-a5478a85b1a7 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.546122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a3ce-5fb1-4e7d-b40f-a5478a85b1a7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:33.546429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a3ce-5fb1-4e7d-b40f-a5478a85b1a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:33.548561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a3ce-5fb1-4e7d-b40f-a5478a85b1a7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:33.561193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 295/592] 10.222.0.58 () {56 vars in 1146 bytes} [Fri Aug 27 03:17:33 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:33.941905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa1595-5c05-4343-ba0f-acf3380a7f78 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.941905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa1595-5c05-4343-ba0f-acf3380a7f78 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.941905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa1595-5c05-4343-ba0f-acf3380a7f78 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.943186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 298/593] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:33.948076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333929f-4bee-4b06-826c-91ab8262305e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:33.948558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333929f-4bee-4b06-826c-91ab8262305e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:33.948723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333929f-4bee-4b06-826c-91ab8262305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:33.972204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c333929f-4bee-4b06-826c-91ab8262305e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:33.973420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c333929f-4bee-4b06-826c-91ab8262305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:33.985215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 296/594] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:34.010026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa1595-5c05-4343-ba0f-acf3380a7f78 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.028026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa1595-5c05-4343-ba0f-acf3380a7f78 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.032970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.033989 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.034457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.034915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.035816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.037586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.053736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 03:17:34.055258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 299/595] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:34.062174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333929f-4bee-4b06-826c-91ab8262305e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.076396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333929f-4bee-4b06-826c-91ab8262305e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.087060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bcdd9-650b-4623-9acc-62403686d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.087768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bcdd9-650b-4623-9acc-62403686d366 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.088050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bcdd9-650b-4623-9acc-62403686d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.088320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bcdd9-650b-4623-9acc-62403686d366 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.089033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bcdd9-650b-4623-9acc-62403686d366 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.089337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bcdd9-650b-4623-9acc-62403686d366 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.090948 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bcdd9-650b-4623-9acc-62403686d366 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.099487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 297/596] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.105611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.120933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73da46-a45d-46a6-b9e5-6e300844ebc1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.130138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.131201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.131705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.132213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.133133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.133641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.134877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:34.134877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:34.134877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:34.136192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6b373-1afa-480d-93ea-8885ee8e5d94 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.148746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 300/597] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/services?type=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.202401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326996c1-9fb1-4a2f-9f03-47b388c1ca38 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.202581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326996c1-9fb1-4a2f-9f03-47b388c1ca38 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.202860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326996c1-9fb1-4a2f-9f03-47b388c1ca38 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.205092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 298/598] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:34.211866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a522c2-1144-46c9-9b2c-c5419dab4fe9 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.212147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a522c2-1144-46c9-9b2c-c5419dab4fe9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.212427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a522c2-1144-46c9-9b2c-c5419dab4fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.238337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-82a522c2-1144-46c9-9b2c-c5419dab4fe9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:34.239629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-82a522c2-1144-46c9-9b2c-c5419dab4fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:34.247893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 301/599] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:34.279949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326996c1-9fb1-4a2f-9f03-47b388c1ca38 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.298846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326996c1-9fb1-4a2f-9f03-47b388c1ca38 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.307630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.308764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.309041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.309316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.333249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:34.340241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:34.341502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 299/600] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:34.348529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a522c2-1144-46c9-9b2c-c5419dab4fe9 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.358191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a522c2-1144-46c9-9b2c-c5419dab4fe9 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.372337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.373030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.373310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.373589 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.374348 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.374659 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.376463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.386163 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 302/601] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.392333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.402621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eac601-e8ec-4d91-add8-58975a370731 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.410541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.411629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.412152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.412610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.429498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.431732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.456960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:34.458513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 300/602] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:34.464768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.488810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea11a0-6b8b-4d38-a5ce-1ae6322b91fc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.500321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5ac02-578c-4523-a481-f2fda5aa2d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.501156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5ac02-578c-4523-a481-f2fda5aa2d5e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.501661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5ac02-578c-4523-a481-f2fda5aa2d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.501942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5ac02-578c-4523-a481-f2fda5aa2d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.502703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5ac02-578c-4523-a481-f2fda5aa2d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.503011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5ac02-578c-4523-a481-f2fda5aa2d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.504718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5ac02-578c-4523-a481-f2fda5aa2d5e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.518044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 303/603] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.524202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.536705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5f5a-2207-4404-a1c5-192fcf165c40 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.548077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.548884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.549160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.549430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.560874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7770b-b85c-4f79-836b-159854cdf6be None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.561171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7770b-b85c-4f79-836b-159854cdf6be None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.561451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7770b-b85c-4f79-836b-159854cdf6be None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.563822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 304/604] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:34.565291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.567673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.569663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15efb80-74d5-4133-baae-dc5b45753167 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.569960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15efb80-74d5-4133-baae-dc5b45753167 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.570238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15efb80-74d5-4133-baae-dc5b45753167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.588775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f15efb80-74d5-4133-baae-dc5b45753167 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:34.589188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:17:34.589966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f15efb80-74d5-4133-baae-dc5b45753167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:34.595801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 301/605] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:34.596720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.599023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 305/606] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:34.609219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5293433-41d2-4782-be46-2c7e6c995220 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.619770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.620572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.620958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.621341 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.622260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.622675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.624384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15efb80-74d5-4133-baae-dc5b45753167 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.624898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.636252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15efb80-74d5-4133-baae-dc5b45753167 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.645055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.645864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.646142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.646414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.662992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 302/607] 10.222.0.58 () {56 vars in 1157 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.667407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.669266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.670793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.688122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:34.688564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b9a4a-8a8c-4b9e-9286-f3851ea97409 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.689701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 306/608] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:34.696667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.699118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.699817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.700098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.700374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.714542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a184ab-d133-4274-8097-9289e575ed43 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.717682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.719617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.726557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.727219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.727528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.727804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.728525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.728830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.730421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.738174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 303/609] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:34.744484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.744786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 307/610] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.752522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.755508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b81b2-18ca-4482-b357-40caced26a01 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.760105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.760956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.761237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.761572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.772574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.773253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce9fa-8d88-45d8-8991-8e7bd9d6afda admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.774410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.788140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.788922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.789280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.789626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.790421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.792485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.792599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:34.794285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 304/611] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:34.804324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.815021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e24b1-d53c-4885-acdd-d7d847779abd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.819814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.820666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.821027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.821363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.822228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.822641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.825208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 308/612] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:17:34 2021] POST /identity/v3/users => generated 254 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:17:34.832526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.852896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 305/613] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.859167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.877927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61340-5100-4faf-82b5-5974118c37bf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.889530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.890359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.890647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.890955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.908757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.910761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.929381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:34.930973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 309/614] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:34.937816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.948119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad75e-18b5-4981-ac0e-70fa6aa80cbb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.952972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff040b8-1688-4b76-97e6-11761be0b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.953958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff040b8-1688-4b76-97e6-11761be0b341 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.954278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff040b8-1688-4b76-97e6-11761be0b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.954537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff040b8-1688-4b76-97e6-11761be0b341 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.955394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff040b8-1688-4b76-97e6-11761be0b341 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.955695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff040b8-1688-4b76-97e6-11761be0b341 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.957575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff040b8-1688-4b76-97e6-11761be0b341 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:34.972004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 306/615] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:34.978500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:34.989331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8e5a7-bc76-4b85-9c73-98393fa9a99a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:34.994043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d2da0-eb37-4e93-9ef9-baf506eedf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:34.994797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2da0-eb37-4e93-9ef9-baf506eedf23 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:34.995146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2da0-eb37-4e93-9ef9-baf506eedf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:34.995517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2da0-eb37-4e93-9ef9-baf506eedf23 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:34.996438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d2da0-eb37-4e93-9ef9-baf506eedf23 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=f9170b262488467fad0bf6aad8d3814a) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:34.996823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d2da0-eb37-4e93-9ef9-baf506eedf23 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:34.998755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d2da0-eb37-4e93-9ef9-baf506eedf23 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:35.005780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 310/616] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:34 2021] GET /identity/v3/role_assignments?user.id=f9170b262488467fad0bf6aad8d3814a&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:36.365448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfb234-729f-4fd2-9b0f-a4b9561d7ed0 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.366523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfb234-729f-4fd2-9b0f-a4b9561d7ed0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.367014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfb234-729f-4fd2-9b0f-a4b9561d7ed0 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.369505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 307/617] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:36.375758 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69e8a-1d5e-463a-88bd-39183b44f0f1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.377046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69e8a-1d5e-463a-88bd-39183b44f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.377816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69e8a-1d5e-463a-88bd-39183b44f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.401670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-2dd69e8a-1d5e-463a-88bd-39183b44f0f1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:36.403340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2dd69e8a-1d5e-463a-88bd-39183b44f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:36.422868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 311/618] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:36.459660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfb234-729f-4fd2-9b0f-a4b9561d7ed0 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.472443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7383fb-b0ec-46f8-aa64-6ef2b32e4762 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.473060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7383fb-b0ec-46f8-aa64-6ef2b32e4762 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.473546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7383fb-b0ec-46f8-aa64-6ef2b32e4762 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.475673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 312/619] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:36.477385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfb234-729f-4fd2-9b0f-a4b9561d7ed0 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.481509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a2442-5f58-42f5-98a6-fcecff4bf1bf None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.482007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a2442-5f58-42f5-98a6-fcecff4bf1bf None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.482480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a2442-5f58-42f5-98a6-fcecff4bf1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.485119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.485783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.486059 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.486329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.487048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:36.488110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:36.488110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:36.488110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:36.488976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:36.503642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0f5a2442-5f58-42f5-98a6-fcecff4bf1bf None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:36.505344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0f5a2442-5f58-42f5-98a6-fcecff4bf1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:36.514247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 313/620] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:36.523097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 308/621] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:17:36 2021] POST /identity/v3/services => generated 251 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:36.539837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a2442-5f58-42f5-98a6-fcecff4bf1bf None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.552994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a2442-5f58-42f5-98a6-fcecff4bf1bf None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.600134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.600960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.601241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.601511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.626838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:36.635184 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:36.639445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 314/622] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:36.650758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.670134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30848cc0-beef-4c95-994d-4dbbba2928ee admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.674891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.675627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.675909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.676211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.677197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:36.677614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:36.683526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:36.699067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 309/623] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:36.704998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.721535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def77ad-8536-44f7-b93b-3e9f957c8827 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.730640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.731493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.731769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.732036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.748716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:36.750684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:36.774685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:36.776407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 315/624] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:36.782981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.801531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d9e84-ce99-4b90-9ec3-71e0c74cf69f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.805836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.807443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.807443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.807443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.808284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:36.808590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:36.810826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:36.825674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 310/625] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:36.832194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.844790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28496078-5c61-4972-be1b-5edb11d9785d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.850732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.852153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.852530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.852811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.862401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:36.864601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:36.882710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:17:36.884197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 316/626] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:17:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:36.890437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.903717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd48dd-b1d0-4dec-89c2-5ac82d713400 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.908516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aabd7-f427-4fdc-aaf4-b572453ac344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.909204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aabd7-f427-4fdc-aaf4-b572453ac344 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.909538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aabd7-f427-4fdc-aaf4-b572453ac344 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.909811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aabd7-f427-4fdc-aaf4-b572453ac344 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.910662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aabd7-f427-4fdc-aaf4-b572453ac344 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:36.911047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aabd7-f427-4fdc-aaf4-b572453ac344 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:36.912968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aabd7-f427-4fdc-aaf4-b572453ac344 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:36.933488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 311/627] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:17:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:36.939843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:36.950549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555d63-4684-45fc-b0c0-dcf62438811f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:36.955596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:36.956396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.956698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.956941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.970079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117f40-86e7-41d4-888c-d607280ba0eb None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.970520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117f40-86e7-41d4-888c-d607280ba0eb None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.970804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a117f40-86e7-41d4-888c-d607280ba0eb None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.973003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:36.973211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 312/628] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:36.975301 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:36.980471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560409b-83e0-44f2-ae7f-21935d4b8e3f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:36.980752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560409b-83e0-44f2-ae7f-21935d4b8e3f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:36.981565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560409b-83e0-44f2-ae7f-21935d4b8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:36.999760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:37.000914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3560409b-83e0-44f2-ae7f-21935d4b8e3f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:37.001880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 317/629] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:37.007473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3560409b-83e0-44f2-ae7f-21935d4b8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:37.017120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.023016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 313/630] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:36 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:37.036795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c865-9519-4127-b940-7ba71e24758b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.041632 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.042472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.043045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.043716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.044617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:37.045023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.047183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.048032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560409b-83e0-44f2-ae7f-21935d4b8e3f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.060007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560409b-83e0-44f2-ae7f-21935d4b8e3f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.066849 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.068496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.068934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.069492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.070502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.072544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.081886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 318/631] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:37.089225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.089806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 314/632] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:17:37 2021] POST /identity/v3/services => generated 240 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:17:37.109078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072fd3-e0a3-41a8-afc1-fc1e9a1b4a15 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.136932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.137823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.138290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.138666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.157132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.161064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.189123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:37.190913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 319/633] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:37.197296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.216531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0f148-11e1-42df-ac27-9242d5a58dca admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.224273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd06d2-b879-4172-a87b-bb2037c7914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.225192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd06d2-b879-4172-a87b-bb2037c7914c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.225648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd06d2-b879-4172-a87b-bb2037c7914c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.226078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd06d2-b879-4172-a87b-bb2037c7914c admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.227090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd06d2-b879-4172-a87b-bb2037c7914c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:37.227599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd06d2-b879-4172-a87b-bb2037c7914c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.229731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd06d2-b879-4172-a87b-bb2037c7914c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.248759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 315/634] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:37.256688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.276827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0cd64-4da4-4e4c-b636-4aaacc083197 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.287647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4283dd-f964-4c20-b3c7-1cd8494fc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.288733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4283dd-f964-4c20-b3c7-1cd8494fc944 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.290422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4283dd-f964-4c20-b3c7-1cd8494fc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.290831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4283dd-f964-4c20-b3c7-1cd8494fc944 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/068da11e10ca4a788bb08a42206ca42e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.293131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4283dd-f964-4c20-b3c7-1cd8494fc944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=068da11e10ca4a788bb08a42206ca42e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.295978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4283dd-f964-4c20-b3c7-1cd8494fc944 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.319075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 320/635] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:37 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/068da11e10ca4a788bb08a42206ca42e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:37.613246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0edea-39f3-4b93-84f3-d90e215754ef None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.614223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0edea-39f3-4b93-84f3-d90e215754ef None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.614736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0edea-39f3-4b93-84f3-d90e215754ef None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.616751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 316/636] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:37.624814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74bf6-02e0-4ee2-b1d2-4e85213378d9 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.625823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74bf6-02e0-4ee2-b1d2-4e85213378d9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.626378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74bf6-02e0-4ee2-b1d2-4e85213378d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.644667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3ea74bf6-02e0-4ee2-b1d2-4e85213378d9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:37.646209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3ea74bf6-02e0-4ee2-b1d2-4e85213378d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:37.713641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 321/637] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:37 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:37.760878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0edea-39f3-4b93-84f3-d90e215754ef None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.776911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0edea-39f3-4b93-84f3-d90e215754ef None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.781957 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.783028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.783523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.784005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.795527 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:37.802794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:37.804261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 317/638] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:37.811065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74bf6-02e0-4ee2-b1d2-4e85213378d9 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.820645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74bf6-02e0-4ee2-b1d2-4e85213378d9 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.825550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.826501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.826971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.827500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.828665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:37.829164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.830966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.840308 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 322/639] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:37.848016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.858529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234b4b-6ecf-42c8-b9ff-4b582c10efd9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.867448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.868564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.869077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.869540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.881157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.883327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.905855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:37.907481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 318/640] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:37.913672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.928257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc0de-878b-43d7-bddb-28de53996e06 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.936485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.937405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.937933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.938401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.939309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:37.939763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.941559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:37.958356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 323/641] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:37.964481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:37.974850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551946d-2671-4ea8-80f6-d2013210b9ad admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:37.983341 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:37.984412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:37.985010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:37.985482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:37.995242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:37.997795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.018592 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:17:38.024406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 319/642] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:17:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:38.030699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.041078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46281a-04bd-4582-888c-12d6c32ac934 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.047561 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4dfb6-83a3-4d9c-bf0f-2991e5e33dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.048365 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4dfb6-83a3-4d9c-bf0f-2991e5e33dcf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.048685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4dfb6-83a3-4d9c-bf0f-2991e5e33dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.048961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4dfb6-83a3-4d9c-bf0f-2991e5e33dcf admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.049906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4dfb6-83a3-4d9c-bf0f-2991e5e33dcf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.050217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4dfb6-83a3-4d9c-bf0f-2991e5e33dcf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.052112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4dfb6-83a3-4d9c-bf0f-2991e5e33dcf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.077332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 324/643] 10.222.0.58 () {56 vars in 1171 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:38.083260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.101054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cc43-d7a8-45d2-8e0e-4c301e6ff97c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.101350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cc43-d7a8-45d2-8e0e-4c301e6ff97c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.101624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cc43-d7a8-45d2-8e0e-4c301e6ff97c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.102368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66cc80-d095-40c4-8f92-ccf7820c41b6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.103599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 325/644] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:38.110505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8643040-4bc9-4932-8f68-4c9b49c16296 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.110998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8643040-4bc9-4932-8f68-4c9b49c16296 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.111494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8643040-4bc9-4932-8f68-4c9b49c16296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.112601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.113294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.113581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.113855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.129847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a8643040-4bc9-4932-8f68-4c9b49c16296 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:38.131063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a8643040-4bc9-4932-8f68-4c9b49c16296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:38.131433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.133416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.152915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 320/645] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:38.153546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 326/646] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:38 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:38.161432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.176772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b222-2752-4e19-b27e-af9e2e752711 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.181277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.182073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.182353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.182621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.185699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8643040-4bc9-4932-8f68-4c9b49c16296 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.197532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8643040-4bc9-4932-8f68-4c9b49c16296 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.205887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.208037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.208934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.209214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.209488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.211091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.229197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:38.243371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:38.243371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 327/647] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:38.244496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.244796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:38.246543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 321/648] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:38.255786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.260213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ef9d-0032-4f88-af38-1c8c895be8ac admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.264907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.265939 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.265939 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.266230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.267018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.267307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.268995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.275376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd142-003d-4b91-b624-553e80477b4b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.281158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.282279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.282781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.283059 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.286234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.286549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.287056 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 328/649] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:38.288669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.296258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.308029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392348a5-085f-43d4-9645-f8b26f7b82f9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.313970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.314971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.316850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.317130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.317973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 322/650] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:38.325772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.337915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b64ebc-b2f7-48b3-b42b-67ec7c92bda8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.339070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.341170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.342662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.343838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.344236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.344513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.362244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:38.364300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 329/651] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:38.364665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.366710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.375430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.385633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:38.387103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 323/652] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:38.390904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895e8ee-4e2f-4bd5-8b2c-ff2af8f2d78b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.395423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.400000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.401547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.402303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.402773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.403734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.404233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.404350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052b6ab-4aab-4f93-93bd-c016f0a10d6e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.406180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.419764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 330/653] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:38.424082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.424770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.425148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.425402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.426202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.426300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.426515 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.428403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.444796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 324/654] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:38.451477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.452540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989c80c-3718-4d94-8f4d-5c1282a79f90 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.462628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753293e1-521d-4eb6-beeb-3c14b0ad70d7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.467570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.468494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.469098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.469588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.470855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=0d95b35088f34ce3b36e94f47ef389c0) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.471429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.473585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.480672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 325/655] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/role_assignments?user.id=0d95b35088f34ce3b36e94f47ef389c0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:38.487493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.487493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.487493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.487493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.510919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.513017 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.539675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:17:38.541299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 331/656] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/users/swift => generated 83 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:38.549233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.570002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44a4c-d1b1-41fc-8ff1-28eccb823696 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.577545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.578626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.579108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.579629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.580720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.581236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.583341 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.603746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 326/657] 10.222.0.58 () {56 vars in 1157 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:38.610821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.629482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172d82d-ff86-48cb-9a28-a4b880d33ce1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.644179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.644857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.645139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.645413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.660071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.661911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.678195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 332/658] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:38.685122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.704393 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7724-7643-40ef-b3bc-90a5a7d0b9e9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.709946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.711020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.711596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.712066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.723892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.726085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.751464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:38.753206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 327/659] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:38.759937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.777925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634cbfc-4d37-4a22-a7af-e9fb79960c01 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.788555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.789231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.789515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.789791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.790527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.790836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.792541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.813302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 333/660] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:38.819210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.829946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76ddd-d6eb-4b6c-ab5e-5d0919c9662d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.845750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.846566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.846848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.847120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.864606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.866600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.883039 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:38.889721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 328/661] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:38.891117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.908575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424579e2-b0b2-4a82-bda3-3ed5d9e46d37 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.925437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27243-f254-4ffa-9e47-32c8457a078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.926117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27243-f254-4ffa-9e47-32c8457a078c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.926399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27243-f254-4ffa-9e47-32c8457a078c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.926675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27243-f254-4ffa-9e47-32c8457a078c admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.927512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee27243-f254-4ffa-9e47-32c8457a078c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.927822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee27243-f254-4ffa-9e47-32c8457a078c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.929699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee27243-f254-4ffa-9e47-32c8457a078c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.948793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 334/662] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:38.955718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:38.972744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a60eab-6ef7-4e32-b017-385fc75a6c77 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:38.983528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab5d58-834b-4559-9464-fe5a66e07ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:38.984191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5d58-834b-4559-9464-fe5a66e07ffe admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:38.984471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5d58-834b-4559-9464-fe5a66e07ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:38.984826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab5d58-834b-4559-9464-fe5a66e07ffe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:38.985661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5d58-834b-4559-9464-fe5a66e07ffe admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=f9170b262488467fad0bf6aad8d3814a) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:38.986133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5d58-834b-4559-9464-fe5a66e07ffe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:38.988031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab5d58-834b-4559-9464-fe5a66e07ffe admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:38.999635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 329/663] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:38 2021] GET /identity/v3/role_assignments?user.id=f9170b262488467fad0bf6aad8d3814a&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:39.520609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd54d-e9ec-442b-a244-1316024ef39c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.520983 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd54d-e9ec-442b-a244-1316024ef39c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.521174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dd54d-e9ec-442b-a244-1316024ef39c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.523151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 335/664] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:39.541757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0eaad-388e-4c31-b2b3-ea0b89d788ae None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.542042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0eaad-388e-4c31-b2b3-ea0b89d788ae None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.542300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0eaad-388e-4c31-b2b3-ea0b89d788ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.568542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-53c0eaad-388e-4c31-b2b3-ea0b89d788ae None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:39.569863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-53c0eaad-388e-4c31-b2b3-ea0b89d788ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:39.578045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 330/665] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:39 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:39.603237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd54d-e9ec-442b-a244-1316024ef39c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:39.624925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dd54d-e9ec-442b-a244-1316024ef39c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:39.632859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:39.633675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.633954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.634222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.634876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:39.636505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:39.649502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 03:17:39.651337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 336/666] 10.222.0.58 () {56 vars in 1151 bytes} [Fri Aug 27 03:17:39 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:39.657829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0eaad-388e-4c31-b2b3-ea0b89d788ae None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:39.672616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0eaad-388e-4c31-b2b3-ea0b89d788ae None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:39.679743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:39.680435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.680716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.680989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.681740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:39.682019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:39.684042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:39.696335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 331/667] 10.222.0.58 () {56 vars in 1146 bytes} [Fri Aug 27 03:17:39 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:39.702356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:39.714916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee74170-3568-4cc8-b7c9-71aa4eca71ff admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:39.721756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c4add-6ab4-4699-a44e-17dbd09f4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:39.722730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4add-6ab4-4699-a44e-17dbd09f4281 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.723270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4add-6ab4-4699-a44e-17dbd09f4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.723775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c4add-6ab4-4699-a44e-17dbd09f4281 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.724748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c4add-6ab4-4699-a44e-17dbd09f4281 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:39.725271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c4add-6ab4-4699-a44e-17dbd09f4281 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:39.727127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c4add-6ab4-4699-a44e-17dbd09f4281 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:39.736824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 337/668] 10.222.0.58 () {56 vars in 1146 bytes} [Fri Aug 27 03:17:39 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:39.743223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:39.757252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14f7d7-2165-457d-91d0-9949d425bec6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:39.767932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:39.768597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.768874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.769153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.769951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] RBAC: Adding query filter params (interface=public, service_id=58bc574d167343548a3a06a7d9f45e16, region_id=RegionOne) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:39.770262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:39.771290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:39.771290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:39.771290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:39.772193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:39.785947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 332/669] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:17:39 2021] GET /identity/v3/endpoints?service_id=58bc574d167343548a3a06a7d9f45e16&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:39.791252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006cee9-9c76-41d0-9e70-03a808e9259c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.791585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006cee9-9c76-41d0-9e70-03a808e9259c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.791867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006cee9-9c76-41d0-9e70-03a808e9259c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.793873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 338/670] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:39.796170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:39.799864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa09e-da53-4e5a-877b-511744e4fdf3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.800148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa09e-da53-4e5a-877b-511744e4fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.800439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa09e-da53-4e5a-877b-511744e4fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.820192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c8f08-dfbe-482f-b582-f6d298991495 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:39.831882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:39.832565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.832848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.833125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.833815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:39.835468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:39.845037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b9ffa09e-da53-4e5a-877b-511744e4fdf3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:39.846247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b9ffa09e-da53-4e5a-877b-511744e4fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:39.846836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 333/671] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:17:39 2021] GET /identity/v3/services => generated 772 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:39.871294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 339/672] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:39 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:39.904331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:39.917192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844d82-79bf-467a-8846-1cad4d3befb9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:39.932680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:39.933912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.934235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.934509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.935172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:39.936281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:39.936281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:39.936281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:39.937223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:39.957790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 03:17:39.959398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 334/673] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:39 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:39.966006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa09e-da53-4e5a-877b-511744e4fdf3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:39.980953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa09e-da53-4e5a-877b-511744e4fdf3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:39.990762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:39.991853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:39.992364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:39.992833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:39.993766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:39.994275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:39.996132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.005527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 340/674] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:39 2021] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.018948 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.034060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf60e6-c685-4739-9691-d8aed0296cf0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.043855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.044912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.045419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.045887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.046818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] RBAC: Adding query filter params (type=network) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.047511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.049402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.055929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 335/675] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/services?type=network => generated 350 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.063250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.076910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a74e7-e32a-4ef6-bedb-ba71ab9b6273 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.086593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.087648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.088151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.088613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.089602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] RBAC: Adding query filter params (interface=public, service_id=14552a86612c43fdbc8f458ce41b5e81, region_id=RegionOne) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.090106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.091327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:40.091327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:40.091327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:40.092597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c522cf-cca6-4bf1-98df-233be0e52a75 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.106415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 341/676] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/endpoints?service_id=14552a86612c43fdbc8f458ce41b5e81&interface=public®ion_id=RegionOne => generated 194 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.113371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.124105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0036-d4fb-44ba-9248-4fe7c971db3a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.135628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef6052-d912-4abb-8ccb-a695d2e0eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.136337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6052-d912-4abb-8ccb-a695d2e0eee4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.136623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6052-d912-4abb-8ccb-a695d2e0eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.136918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef6052-d912-4abb-8ccb-a695d2e0eee4 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.137647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef6052-d912-4abb-8ccb-a695d2e0eee4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.139270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef6052-d912-4abb-8ccb-a695d2e0eee4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.145256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 336/677] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/services => generated 772 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.150594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627dbe9-47a4-44e8-af56-5df54e0c8b67 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.150878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627dbe9-47a4-44e8-af56-5df54e0c8b67 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.151157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627dbe9-47a4-44e8-af56-5df54e0c8b67 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.154558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 342/678] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:40.160129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fce32-d5e8-4d23-86e4-9d8939e1ed25 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.160415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fce32-d5e8-4d23-86e4-9d8939e1ed25 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.160695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fce32-d5e8-4d23-86e4-9d8939e1ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.179575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-477fce32-d5e8-4d23-86e4-9d8939e1ed25 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:40.180844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-477fce32-d5e8-4d23-86e4-9d8939e1ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:40.195520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 337/679] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:40 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:40.215810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627dbe9-47a4-44e8-af56-5df54e0c8b67 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.229348 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627dbe9-47a4-44e8-af56-5df54e0c8b67 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.234129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.235087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.235464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.235858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.248859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:40.256150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:40.263148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 343/680] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:40.264670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fce32-d5e8-4d23-86e4-9d8939e1ed25 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.274459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fce32-d5e8-4d23-86e4-9d8939e1ed25 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.279169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.279921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.280245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.280516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.281277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.281620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.283454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.295440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 338/681] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.299923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.310640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5e447-0c2c-4410-9f9d-35ccb687171a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.315586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.316444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.316776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.317053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.329245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.331232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.354195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:40.359471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 344/682] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:40.362225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.378953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f889-cb99-4944-861f-85306344d54e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.383627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.384351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.384632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.384917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.385669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.385974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.387666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.406203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 339/683] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.414581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.429735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad17b5-fdb6-42c9-8fc8-5da5c096a9f0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.443907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.444809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.445094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.445372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.455069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.457210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.479144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:17:40.486517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 345/684] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:40.487958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.498130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de8f4-3bcf-4888-800a-ad07ff95d677 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.503757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.504434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.504718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.505040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.505896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.506255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.508254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.531851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 340/685] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.534691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.545473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514946e9-66cc-4450-accf-5e15f18b07e2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.551511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.552185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.552525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.552801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.562296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.565490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.579485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 346/686] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:40.582579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.593069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e018e-9bd1-4f98-b73e-a1c567721b08 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.598763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.599653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.599984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.600262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.615305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.617396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.638899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:40.640314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 341/687] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:40.646568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.655911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b19c6-630d-4a03-96c4-a420c9799e09 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.662995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.663718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.664001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.664273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.665003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.665307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.666904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.683150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 347/688] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.686090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.700303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d2f3f-3cfc-4a8a-ac87-c97b840d189c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.706384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.707236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.707539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.707809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.719934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.722011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.736723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:40.740038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 342/689] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:40.744705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.756152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1580b-80fd-43ca-a11c-08071090e3d7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.763266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee84b3c-1637-409f-bc31-df99b8527b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.763953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84b3c-1637-409f-bc31-df99b8527b09 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.764273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84b3c-1637-409f-bc31-df99b8527b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.764546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84b3c-1637-409f-bc31-df99b8527b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.765377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee84b3c-1637-409f-bc31-df99b8527b09 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.765689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee84b3c-1637-409f-bc31-df99b8527b09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.767663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee84b3c-1637-409f-bc31-df99b8527b09 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.787240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 348/690] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:40.794062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:40.806366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987ad6-16e3-4d67-91ef-9bd47597730a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:40.814399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed0251-b473-4a67-a61e-b4a263fc60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:40.815097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0251-b473-4a67-a61e-b4a263fc60eb admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:40.815399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0251-b473-4a67-a61e-b4a263fc60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:40.815676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0251-b473-4a67-a61e-b4a263fc60eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:40.816557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0251-b473-4a67-a61e-b4a263fc60eb admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=068da11e10ca4a788bb08a42206ca42e) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:40.816866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0251-b473-4a67-a61e-b4a263fc60eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:40.818772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0251-b473-4a67-a61e-b4a263fc60eb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:40.828411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 343/691] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:40 2021] GET /identity/v3/role_assignments?user.id=068da11e10ca4a788bb08a42206ca42e&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:41.153626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69ed44-f249-49a4-ae57-975c6ebba572 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.153626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69ed44-f249-49a4-ae57-975c6ebba572 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.153626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69ed44-f249-49a4-ae57-975c6ebba572 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.153626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 349/692] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:41.164286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc23b-c86d-4036-b468-2c9c96fb6d45 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.164286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc23b-c86d-4036-b468-2c9c96fb6d45 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.164286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fc23b-c86d-4036-b468-2c9c96fb6d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.183595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cf0fc23b-c86d-4036-b468-2c9c96fb6d45 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:41.185151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cf0fc23b-c86d-4036-b468-2c9c96fb6d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:41.194857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 344/693] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:41 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:41.219236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69ed44-f249-49a4-ae57-975c6ebba572 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.236978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69ed44-f249-49a4-ae57-975c6ebba572 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.242615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.243686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.244155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.244610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.261973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:41.269224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:41.270965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 350/694] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:41.277897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fc23b-c86d-4036-b468-2c9c96fb6d45 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.287613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fc23b-c86d-4036-b468-2c9c96fb6d45 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.293505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.294395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.294886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.295368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.296309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:41.296805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.298747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.308587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 345/695] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:41.315225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.325619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b48ac-aeb1-4a04-8331-c58c50a54163 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.330841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.331940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.332413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.332881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.348313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.350491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.371644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:41.373536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 351/696] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:41.380070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.390197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425dbf8-8a55-4946-9f7e-f12b5824eb89 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.395174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.399392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.399392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.399392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.399392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:41.399392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.399392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.412212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 346/697] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:41.418242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.432643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc090ba-b1dc-4b9e-b5b5-2783551392bb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.442998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.443855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.444130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.444396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.454633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.456717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.476557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:17:41.478088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 352/698] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:41.484335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.494423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a8fc3-2ec8-496b-b12b-61257286aa37 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.509024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.509709 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.509992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.510269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.511123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:41.511596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.513465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.542740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 347/699] 10.222.0.58 () {56 vars in 1171 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:41.548859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.565190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2cad-1833-4f1d-b85d-7627d36c6ea6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.574900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.575752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.575999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.576268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.593478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.595531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.617537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:41.618737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 353/700] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:41.624989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.644684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7eec4-a2e9-4e16-a96a-aaf419a97b91 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.655950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.656656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.656973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.657335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.658069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:41.658375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.660114 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.676666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 348/701] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:41.683209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.696711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cb21e-eca9-40b4-a6d9-3617bb334815 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.707090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.707929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.708204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.708472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.716012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.717976 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.736457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:41.738045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 354/702] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:41.744465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.760701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597390-42d2-479b-80e7-4f1d6bd44545 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.772576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7f9a7-d177-4744-929c-f1b17a6ff3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.773253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7f9a7-d177-4744-929c-f1b17a6ff3fd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.773541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7f9a7-d177-4744-929c-f1b17a6ff3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.773821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7f9a7-d177-4744-929c-f1b17a6ff3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.774628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7f9a7-d177-4744-929c-f1b17a6ff3fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:41.774937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7f9a7-d177-4744-929c-f1b17a6ff3fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.776833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7f9a7-d177-4744-929c-f1b17a6ff3fd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.800792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 349/703] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:41.806919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.816775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d28e-5b6b-4140-a133-e769b036e045 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.817758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d28e-5b6b-4140-a133-e769b036e045 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.818047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d28e-5b6b-4140-a133-e769b036e045 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.820491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 350/704] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:41.820838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacf191-ee92-48d2-a1af-e9227470c4f0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.826529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf1412-198d-4889-96a2-d628a9da94b0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.826816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf1412-198d-4889-96a2-d628a9da94b0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.827111 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf1412-198d-4889-96a2-d628a9da94b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.828779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.830003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.830378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.830649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/0d95b35088f34ce3b36e94f47ef389c0/roles/fe4243b37e174c0c856029d03e170fac` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:41.860797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-17cf1412-198d-4889-96a2-d628a9da94b0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:41.862117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-17cf1412-198d-4889-96a2-d628a9da94b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:41.864453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=0d95b35088f34ce3b36e94f47ef389c0, role_id=fe4243b37e174c0c856029d03e170fac)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:41.866963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:41.874405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 351/705] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:41 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:41.886167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 355/706] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:41 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/0d95b35088f34ce3b36e94f47ef389c0/roles/fe4243b37e174c0c856029d03e170fac => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:41.907660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf1412-198d-4889-96a2-d628a9da94b0 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:41.917649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf1412-198d-4889-96a2-d628a9da94b0 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:41.993338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:41.994547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:41.995045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:41.995537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.016364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:42.023635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:42.025296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 352/707] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:42.032187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.049373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24810a-e21c-46bf-9c12-00861a8821f0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.060039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.060737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.061020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.061304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.062160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:42.062473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.064745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.080483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 356/708] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:42.086758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.100722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3c0fd-4f78-4de9-bed0-4dc8ff03cec2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.111558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.112755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.113256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.113721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.131666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.133576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.158695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:42.160293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 353/709] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:42.166508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.177679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6c21-b989-4827-ae96-c792729f6643 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.184741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.185465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.185797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.186074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.186860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:42.187114 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.189131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.204459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 357/710] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:42.210682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.221693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc0cf2-7fbf-4475-b83d-ff739b0dd519 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.228130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.228931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.229210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.229477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.241339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.243507 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.262047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:17:42.263714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 354/711] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:42.270649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.283929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b597e-ec65-4b46-8728-e6455a34838e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.291927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.293000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.293422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.293841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.295090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:42.295662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.298278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.332144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 358/712] 10.222.0.58 () {56 vars in 1157 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:42.338171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.352597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e19f1f-53c2-4000-82f1-a0887d15abc2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.359677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.360677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.360964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.361244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.380584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.382468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.414488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:42.415963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 355/713] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:42.422442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.436626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe62db-535a-41a5-9322-6986fa5e11fc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.446291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.447014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.447358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.447641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.448383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:42.448730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.450484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.468626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 359/714] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:42.474682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.488721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb4e6-8eaf-4aa0-87d8-bca905af2d91 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.499747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.504477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.504784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.505040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.516866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.518876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.535155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:42.536413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 356/715] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:42.543191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.560864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd5b4-365e-43c5-8159-32cf7545f751 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.571458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2570faf-f689-4fcd-9e94-15be757840df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.572228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570faf-f689-4fcd-9e94-15be757840df admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.572518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570faf-f689-4fcd-9e94-15be757840df admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.572798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570faf-f689-4fcd-9e94-15be757840df admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.573602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2570faf-f689-4fcd-9e94-15be757840df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:42.573965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2570faf-f689-4fcd-9e94-15be757840df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.575977 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2570faf-f689-4fcd-9e94-15be757840df admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.600614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 360/716] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:42.607707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.607960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43dd13-4eec-4c0b-8854-06676eb22e9e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.608211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43dd13-4eec-4c0b-8854-06676eb22e9e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.608398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43dd13-4eec-4c0b-8854-06676eb22e9e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.610521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 361/717] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:42.620903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cda5-1bf1-4003-9eed-95631fb59339 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.621175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cda5-1bf1-4003-9eed-95631fb59339 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.621443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082cda5-1bf1-4003-9eed-95631fb59339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.622750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a699348-25e4-4a3e-a798-732726f5c3b1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.627597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.628491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.628770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.629046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/f9170b262488467fad0bf6aad8d3814a/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.630987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=f9170b262488467fad0bf6aad8d3814a, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.634840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.649040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-9082cda5-1bf1-4003-9eed-95631fb59339 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:42.650476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9082cda5-1bf1-4003-9eed-95631fb59339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:42.654193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 357/718] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:42 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/f9170b262488467fad0bf6aad8d3814a/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:42.718348 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 362/719] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:42 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:42.743073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.754211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadee2c-6258-4cdd-9f19-b2a68264ddcb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.758978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.759878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.760158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.760428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.761154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.762855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.783248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 03:17:42.784905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 358/720] 10.222.0.58 () {56 vars in 1151 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:42.792067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082cda5-1bf1-4003-9eed-95631fb59339 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.807677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082cda5-1bf1-4003-9eed-95631fb59339 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.815487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.816179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.816508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.816787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.817524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:42.817869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.819579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.825422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 363/721] 10.222.0.58 () {56 vars in 1146 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:42.831875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.849610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ee5a0-6919-47cf-9a16-f1a2640e5ea3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.857554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585e0f8-85f0-4c2f-969e-ddd299cdeab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.858237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585e0f8-85f0-4c2f-969e-ddd299cdeab2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.858569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585e0f8-85f0-4c2f-969e-ddd299cdeab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.858852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585e0f8-85f0-4c2f-969e-ddd299cdeab2 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.859770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585e0f8-85f0-4c2f-969e-ddd299cdeab2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:42.860083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585e0f8-85f0-4c2f-969e-ddd299cdeab2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.861931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585e0f8-85f0-4c2f-969e-ddd299cdeab2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.868644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 359/722] 10.222.0.58 () {56 vars in 1146 bytes} [Fri Aug 27 03:17:42 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:42.874449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:42.884513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c860b-1bdd-49f4-9585-1ff3ef29c212 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:42.889366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491de637-453a-4aeb-b3b5-cc09929fc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:42.890026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491de637-453a-4aeb-b3b5-cc09929fc8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:42.890306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491de637-453a-4aeb-b3b5-cc09929fc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:42.890580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491de637-453a-4aeb-b3b5-cc09929fc8a7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:42.891412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491de637-453a-4aeb-b3b5-cc09929fc8a7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:42.892439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-491de637-453a-4aeb-b3b5-cc09929fc8a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:42.892439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:42.892439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:42.893311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491de637-453a-4aeb-b3b5-cc09929fc8a7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:42.915214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 364/723] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:17:42 2021] POST /identity/v3/endpoints => generated 346 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:43.021121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98dcfb-862e-4614-8dbf-d1bbc1fa2e31 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.021441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98dcfb-862e-4614-8dbf-d1bbc1fa2e31 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.021655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98dcfb-862e-4614-8dbf-d1bbc1fa2e31 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.023623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 360/724] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:43.030122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477fac3-6c21-45ca-b68b-4bf37700f146 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.030791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477fac3-6c21-45ca-b68b-4bf37700f146 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.031259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477fac3-6c21-45ca-b68b-4bf37700f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.060197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b477fac3-6c21-45ca-b68b-4bf37700f146 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:43.061808 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b477fac3-6c21-45ca-b68b-4bf37700f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:43.089789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 365/725] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:43 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:43.129594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98dcfb-862e-4614-8dbf-d1bbc1fa2e31 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:43.142563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98dcfb-862e-4614-8dbf-d1bbc1fa2e31 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:43.147406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:43.148445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.148940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.149566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] PATH_INFO: `/v3/services/network` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.150419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:43.152252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:43.163658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 03:17:43.165445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 361/726] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:43 2021] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:43.171943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477fac3-6c21-45ca-b68b-4bf37700f146 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:43.181504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477fac3-6c21-45ca-b68b-4bf37700f146 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:43.186636 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:43.187654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.188306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.189093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.190330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:43.190865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:43.192749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:43.198374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 366/727] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:43 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:43.204529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:43.215601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05625a21-8ad7-4f48-afe3-e24c3ae16a9d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:43.220664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0a47a-4a3b-4292-9105-14d3368a0ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:43.221596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0a47a-4a3b-4292-9105-14d3368a0ecc admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.222119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0a47a-4a3b-4292-9105-14d3368a0ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.222589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0a47a-4a3b-4292-9105-14d3368a0ecc admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.223533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0a47a-4a3b-4292-9105-14d3368a0ecc admin admin] RBAC: Adding query filter params (type=network) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:43.224086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0a47a-4a3b-4292-9105-14d3368a0ecc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:43.225918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0a47a-4a3b-4292-9105-14d3368a0ecc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:43.231847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 362/728] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:43 2021] GET /identity/v3/services?type=network => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:43.238268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:43.248604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33a7f-a7f1-4bf2-8774-74dadc8c4969 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:43.254040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ac918-33c1-4f80-bf54-8f000c8eb9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:43.254926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac918-33c1-4f80-bf54-8f000c8eb9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.255459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac918-33c1-4f80-bf54-8f000c8eb9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.255928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ac918-33c1-4f80-bf54-8f000c8eb9e3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.256921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ac918-33c1-4f80-bf54-8f000c8eb9e3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:43.258851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ac918-33c1-4f80-bf54-8f000c8eb9e3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:43.282162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 367/729] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:17:43 2021] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:17:43.935402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc1c1-2f98-4ff2-b2d7-deeb478c9d23 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.935931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc1c1-2f98-4ff2-b2d7-deeb478c9d23 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.936039 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc1c1-2f98-4ff2-b2d7-deeb478c9d23 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.938179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 363/730] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:43.945301 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b016d5-0772-4fc5-ab21-93bacda2cc0b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:43.945765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b016d5-0772-4fc5-ab21-93bacda2cc0b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:43.945841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b016d5-0772-4fc5-ab21-93bacda2cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:43.970075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e1b016d5-0772-4fc5-ab21-93bacda2cc0b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:43.971439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e1b016d5-0772-4fc5-ab21-93bacda2cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:43.988815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 368/731] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:43 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:44.016185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc1c1-2f98-4ff2-b2d7-deeb478c9d23 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.028735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc1c1-2f98-4ff2-b2d7-deeb478c9d23 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.033646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.034517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.034806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.035125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.035836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.037452 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.049832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 03:17:44.051535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 364/732] 10.222.0.58 () {56 vars in 1154 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:44.058667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b016d5-0772-4fc5-ab21-93bacda2cc0b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.068138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b016d5-0772-4fc5-ab21-93bacda2cc0b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.072791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66884c-51f2-4f94-bfbf-07ae71d20fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.073456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66884c-51f2-4f94-bfbf-07ae71d20fbd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.073736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66884c-51f2-4f94-bfbf-07ae71d20fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.074007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66884c-51f2-4f94-bfbf-07ae71d20fbd admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.074715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66884c-51f2-4f94-bfbf-07ae71d20fbd admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:44.075020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66884c-51f2-4f94-bfbf-07ae71d20fbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.076642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66884c-51f2-4f94-bfbf-07ae71d20fbd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.081953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 369/733] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:44.088183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.098876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f74ea-1b80-4694-87a1-ba01aedcb11c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.103902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1eefb-dbf5-4a11-8bcc-ba2ade63d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.104848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1eefb-dbf5-4a11-8bcc-ba2ade63d984 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.105414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1eefb-dbf5-4a11-8bcc-ba2ade63d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.105914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1eefb-dbf5-4a11-8bcc-ba2ade63d984 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.106823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1eefb-dbf5-4a11-8bcc-ba2ade63d984 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:44.107340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1eefb-dbf5-4a11-8bcc-ba2ade63d984 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.109272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1eefb-dbf5-4a11-8bcc-ba2ade63d984 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.115181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 365/734] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:44.494063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5e4b-4ed4-40a4-8885-57b3a3e861a6 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.494417 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5e4b-4ed4-40a4-8885-57b3a3e861a6 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.494616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5e4b-4ed4-40a4-8885-57b3a3e861a6 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.496652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 370/735] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:44.502990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25aa5e-51a9-4195-8813-323b778de749 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.503272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25aa5e-51a9-4195-8813-323b778de749 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.503574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25aa5e-51a9-4195-8813-323b778de749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.521655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cd25aa5e-51a9-4195-8813-323b778de749 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:44.522842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cd25aa5e-51a9-4195-8813-323b778de749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:44.530691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 366/736] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:44 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:44.554905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5e4b-4ed4-40a4-8885-57b3a3e861a6 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.567839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5e4b-4ed4-40a4-8885-57b3a3e861a6 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.572358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61909898-2912-409e-9506-919bc601643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.573144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61909898-2912-409e-9506-919bc601643c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.573423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61909898-2912-409e-9506-919bc601643c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.573690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61909898-2912-409e-9506-919bc601643c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.584355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61909898-2912-409e-9506-919bc601643c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:44.591082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-61909898-2912-409e-9506-919bc601643c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:17:44.592606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 371/737] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:44.599237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25aa5e-51a9-4195-8813-323b778de749 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.608352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25aa5e-51a9-4195-8813-323b778de749 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.612935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.613593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.613868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.614134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.614874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:44.615173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.616809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.625627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 367/738] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:44.631708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61909898-2912-409e-9506-919bc601643c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.642067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61909898-2912-409e-9506-919bc601643c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.646554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.647268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.647582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.647857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.658273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.660124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.676596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:44.678077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 372/739] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:44.684454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.694495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4a18f-8a4b-4d40-8e0b-670637f7d94e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.699329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.700057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.700378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.700647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.701421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:44.701724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.703473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.721276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 368/740] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:44.722678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.732897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cef2f6-d96c-4d30-9c74-6557be18fa35 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.737802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.738651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.738935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.739211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.747146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.749390 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.764296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:17:44.771111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 373/741] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:44.772520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.782745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7d494-d832-4b01-a17d-0fc281e21313 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.787485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.788205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.788488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.788763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.789658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:44.789968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.791929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.815487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 369/742] 10.222.0.58 () {56 vars in 1171 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:44.817356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.827700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4ff8-76bc-41cd-98c7-b5bf8e73e742 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.832880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.833582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.833861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.834132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.842796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.844718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.859312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 374/743] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:44.860884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.871004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d0267-7c1a-423d-ab25-ed058730358a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.875976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.876751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.877030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.877305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.888351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.890306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.908278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:44.913727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 370/744] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:44.916155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.925698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaeddf-51cc-46f2-b103-4b406aa50d7b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.930602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.931270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.931615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.931887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.932666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:44.933278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.934962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.951575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 375/745] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:44.954522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:44.964918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e331e-3f94-46e8-8567-15b1f23b8317 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:44.969747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:44.970635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:44.970960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:44.971231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:44.979316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:44.981285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:44.996411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:45.003672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 371/746] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:45.005125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.015966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d605bf9-4a33-4fa0-9bb1-6883987373a3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.021087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d1a0-5076-4abe-8383-89e4eb59e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.021805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d1a0-5076-4abe-8383-89e4eb59e589 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.022085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d1a0-5076-4abe-8383-89e4eb59e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.022360 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d1a0-5076-4abe-8383-89e4eb59e589 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.023268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d1a0-5076-4abe-8383-89e4eb59e589 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.023644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d1a0-5076-4abe-8383-89e4eb59e589 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.025558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d1a0-5076-4abe-8383-89e4eb59e589 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.043485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 376/747] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:45.046480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.057693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d27c-1bb5-4eaf-b0ea-3a111e25a925 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.062927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.063849 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.064284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.065968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f917e-4dbd-4982-b37f-5351ae07f81e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.066155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.066324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f917e-4dbd-4982-b37f-5351ae07f81e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.066491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f917e-4dbd-4982-b37f-5351ae07f81e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.066967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=0d95b35088f34ce3b36e94f47ef389c0) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.067284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.068707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 377/748] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:45.069180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.077067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647c7a7-0467-4e8d-95c9-ea234ca230ef None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.077354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647c7a7-0467-4e8d-95c9-ea234ca230ef None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.077627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647c7a7-0467-4e8d-95c9-ea234ca230ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.087749 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 372/749] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/role_assignments?user.id=0d95b35088f34ce3b36e94f47ef389c0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:45.100524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3647c7a7-0467-4e8d-95c9-ea234ca230ef None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:45.101750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3647c7a7-0467-4e8d-95c9-ea234ca230ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:45.110197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 378/750] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:45 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:45.134825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.145189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65464dde-502a-439c-90f4-f06798cb5091 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.150206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.151023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.151301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.151645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.163656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:45.170521 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:17:45.172212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 373/751] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:45.178984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647c7a7-0467-4e8d-95c9-ea234ca230ef None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.188962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647c7a7-0467-4e8d-95c9-ea234ca230ef None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.193687 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.194372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.194652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.194926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.195720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.196028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.197707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.208694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 379/752] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:45.215758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.226816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c3562-438f-4290-8f48-852afd06cdae admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.231653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.232468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.232745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.233013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.245209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.247109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.264683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:45.266325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 374/753] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:45.273057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.282801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9476-08a2-4911-91ae-ef1ef9c1fcdd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.287478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.288193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.288538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.288851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.289581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.289882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.291584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.304662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 380/754] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:45.311071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.321183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67e58-bbcb-49d0-8d3d-f1f783db2071 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.326186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.327033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.327323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.327663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.336306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.338484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.352597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 03:17:45.354135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 375/755] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:45.361777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.379142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ce01-1144-4195-90d6-3b30e09d7628 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.385174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.386302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.386859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.387326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.388445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.388946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.397517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.423592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 381/756] 10.222.0.58 () {56 vars in 1157 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:45.427494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.438435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e021d0c-224c-40cb-ad6c-f42c0af3731a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.443279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f0282-6e2b-4b46-b491-37986f63675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.443965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f0282-6e2b-4b46-b491-37986f63675e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.444293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f0282-6e2b-4b46-b491-37986f63675e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.444635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f0282-6e2b-4b46-b491-37986f63675e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.453201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f0282-6e2b-4b46-b491-37986f63675e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.455866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f0282-6e2b-4b46-b491-37986f63675e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.465908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 376/757] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:45.472269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.482398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2febd28-48bd-4946-9d17-eca5bd804ecf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.487613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.488746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.489225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.489668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa669fde-ec3a-4e9e-9952-1b1795f28fc6 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.489909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.490008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa669fde-ec3a-4e9e-9952-1b1795f28fc6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.490222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa669fde-ec3a-4e9e-9952-1b1795f28fc6 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.492324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 377/758] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:45.497751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc44744-a0bd-4881-abf4-05696ef95c12 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.498034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc44744-a0bd-4881-abf4-05696ef95c12 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.498312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc44744-a0bd-4881-abf4-05696ef95c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.503035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.506381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.516345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cbc44744-a0bd-4881-abf4-05696ef95c12 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:45.517596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cbc44744-a0bd-4881-abf4-05696ef95c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:45.525889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 378/759] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:45 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:45.527241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:45.534101 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 382/760] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:45.535588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc44744-a0bd-4881-abf4-05696ef95c12 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.545102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc44744-a0bd-4881-abf4-05696ef95c12 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.549975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.550682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.550964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.551236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.552073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.552375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.554140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.555116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.571394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 379/761] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:45.573134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc85f77-fb81-41e4-8224-cffe03e3d729 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.574461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.583053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.584168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.584635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.584932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad24f77-a1d8-4375-aea7-e3759975c3a1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.585291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.586272 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.588440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.590476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.591536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.591898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.592236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.600719 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.602495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 03:17:45.602828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.604594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 383/762] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:45.612569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.620536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:45.627290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 380/763] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:45.628850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.630965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fab56-cbf8-4442-ba37-1e26b62e42f1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.638928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.640115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.640619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.641212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.642066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.642299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34939c6d-9b58-4f52-9113-9688744b7eb4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.642703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.645033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.647049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.647873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.648219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.648586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.649703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.650311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.657126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.657306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 384/764] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:45.659601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.673935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 381/765] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:45.674092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd5293-c311-4a87-922a-d5ea6fb1880e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.675962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:45.679313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cba62-507c-4d1c-a8f3-4320eaef6073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.680149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cba62-507c-4d1c-a8f3-4320eaef6073 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.680571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cba62-507c-4d1c-a8f3-4320eaef6073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.680978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cba62-507c-4d1c-a8f3-4320eaef6073 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.682037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cba62-507c-4d1c-a8f3-4320eaef6073 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.683399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cba62-507c-4d1c-a8f3-4320eaef6073 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.685424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cba62-507c-4d1c-a8f3-4320eaef6073 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.686738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c802-f7b7-4948-aed8-93584f72127d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:45.699706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 385/766] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:45.701483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9f773-453c-4733-927e-c467b76d04f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:45.702304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f773-453c-4733-927e-c467b76d04f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:45.702674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f773-453c-4733-927e-c467b76d04f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:45.703082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f773-453c-4733-927e-c467b76d04f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:45.704280 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9f773-453c-4733-927e-c467b76d04f8 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=f9170b262488467fad0bf6aad8d3814a) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:45.704701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9f773-453c-4733-927e-c467b76d04f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:45.706874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9f773-453c-4733-927e-c467b76d04f8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:45.714231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 382/767] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:45 2021] GET /identity/v3/role_assignments?user.id=f9170b262488467fad0bf6aad8d3814a&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:46.393074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fdb01-01f2-4a67-b508-fefdd128ced9 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:46.393074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fdb01-01f2-4a67-b508-fefdd128ced9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:46.393074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fdb01-01f2-4a67-b508-fefdd128ced9 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:46.394423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 386/768] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:46.401140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fd322-53e1-4798-bd4c-e01faf4cc684 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:46.401597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fd322-53e1-4798-bd4c-e01faf4cc684 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:46.401708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fd322-53e1-4798-bd4c-e01faf4cc684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:46.421125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-9a0fd322-53e1-4798-bd4c-e01faf4cc684 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:46.422595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9a0fd322-53e1-4798-bd4c-e01faf4cc684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:46.431019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 383/769] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:46 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:46.456197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fdb01-01f2-4a67-b508-fefdd128ced9 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:46.468921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fdb01-01f2-4a67-b508-fefdd128ced9 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:46.473660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b79e49-2925-4227-a8d7-869132d2e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:46.474323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b79e49-2925-4227-a8d7-869132d2e6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:46.474603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b79e49-2925-4227-a8d7-869132d2e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:46.474874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b79e49-2925-4227-a8d7-869132d2e6e2 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:46.475666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b79e49-2925-4227-a8d7-869132d2e6e2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:46.476689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-d4b79e49-2925-4227-a8d7-869132d2e6e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:46.476689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:17:46.476689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:17:46.477558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b79e49-2925-4227-a8d7-869132d2e6e2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:46.494749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 387/770] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:17:46 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:47.382080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b791-1252-49b9-abd7-05b65963a896 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.382363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b791-1252-49b9-abd7-05b65963a896 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.382644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b791-1252-49b9-abd7-05b65963a896 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.384714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 384/771] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:47.392986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2e34-f5c1-4493-9e4f-379186cbce6d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.392986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2e34-f5c1-4493-9e4f-379186cbce6d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.392986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2e34-f5c1-4493-9e4f-379186cbce6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.411082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-6bee2e34-f5c1-4493-9e4f-379186cbce6d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:47.412598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6bee2e34-f5c1-4493-9e4f-379186cbce6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:47.432514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 388/772] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:47 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:47.459601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b791-1252-49b9-abd7-05b65963a896 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.476206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b791-1252-49b9-abd7-05b65963a896 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.480665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.481480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.481756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.482029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.492801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:47.500072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:17:47.501561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 385/773] 10.222.0.58 () {56 vars in 1142 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:47.508096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee2e34-f5c1-4493-9e4f-379186cbce6d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.518639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee2e34-f5c1-4493-9e4f-379186cbce6d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.523206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.523924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.524203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.524474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.525227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:47.525531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.527107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.536207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 389/774] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:47.542260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.552563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0628d-b80e-479a-877c-68c9f0aecef9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.557170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.558279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.558558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.558833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.570250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.572143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.588818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:47.590330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 386/775] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:47.596619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.606488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18907-c1a3-47f3-af82-0d7eaf3aa800 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.611323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.612077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.612358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.612633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.613364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:47.613666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.615257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.628335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 390/776] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:47.634517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.646218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4769e-0cbe-4944-95e6-62c006e51d0b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.651583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.652394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.652674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.652945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.662093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.664156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.678183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:17:47.679702 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 387/777] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:47.686290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.696134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49581724-9174-4a9c-a6d6-d6a342907a55 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.700764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.701429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.701706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.701975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.702810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:47.703212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.705772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.726291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 391/778] 10.222.0.58 () {56 vars in 1171 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:47.732777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.743413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cc3a1-7da9-4992-ba21-2fc46f67c968 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.748407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.749120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.749480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.749809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.758453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.760309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.769720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 388/779] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:47.776095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.786212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055ca7-81f6-4ce1-b4d3-984eecc3dc2d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.791404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.792442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.792898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.793372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.804816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.806875 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.825312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:47.827281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 392/780] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:47.834296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.844246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7a5c7-376a-48e1-bfb3-8c3b07160c84 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.849967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed17ba-9448-4659-bca8-b3beb2b1b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.850985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed17ba-9448-4659-bca8-b3beb2b1b1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.851487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed17ba-9448-4659-bca8-b3beb2b1b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.851955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed17ba-9448-4659-bca8-b3beb2b1b1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.852884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed17ba-9448-4659-bca8-b3beb2b1b1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:47.853366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed17ba-9448-4659-bca8-b3beb2b1b1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.855162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed17ba-9448-4659-bca8-b3beb2b1b1c2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.868944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 389/781] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:47.875437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.885736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838ea15-fd88-4e52-a748-2ae555c2ba78 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.891082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.892141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.892638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.893103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.900999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.903257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.905490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc993f-f65e-4dc8-9357-eadd11740af8 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.905777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc993f-f65e-4dc8-9357-eadd11740af8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.906309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc993f-f65e-4dc8-9357-eadd11740af8 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.908512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 390/782] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:17:47.915002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1e28-bb18-4608-832f-bafc82219653 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.915283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1e28-bb18-4608-832f-bafc82219653 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.915589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1e28-bb18-4608-832f-bafc82219653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.920771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:47.922766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 393/783] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:47.929635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.935373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2a4b1e28-bb18-4608-832f-bafc82219653 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:47.937980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2a4b1e28-bb18-4608-832f-bafc82219653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:47.941328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc2988-dedf-4816-a101-99f7ffe7d571 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.946168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.947016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.947382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.947729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.948303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 391/784] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:47 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:47.948570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:47.948865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.950735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.967850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 394/785] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:47.974638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b1e28-bb18-4608-832f-bafc82219653 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.975020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:47.984626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b1e28-bb18-4608-832f-bafc82219653 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.985420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baf1ae-ec67-4437-9d1d-fe8e3b798fa4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:47.989170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.989970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.990243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.990509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.991223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.991702 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1d08-561a-4f57-854d-de9c25c953b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:47.992618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1d08-561a-4f57-854d-de9c25c953b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:47.992853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:47.993447 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1d08-561a-4f57-854d-de9c25c953b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:47.993965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1d08-561a-4f57-854d-de9c25c953b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:47.995000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f1d08-561a-4f57-854d-de9c25c953b7 admin admin] RBAC: Adding query filter params (role.id=c1852650b3b54f34ab1f91b15bea4cd5, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=0d95b35088f34ce3b36e94f47ef389c0) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:47.995596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f1d08-561a-4f57-854d-de9c25c953b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:47.997550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f1d08-561a-4f57-854d-de9c25c953b7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.004010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 395/786] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/role_assignments?user.id=0d95b35088f34ce3b36e94f47ef389c0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=c1852650b3b54f34ab1f91b15bea4cd5 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:48.005373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d0674-5dca-4af9-bcdd-46f49f7f0cd8 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.005736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d0674-5dca-4af9-bcdd-46f49f7f0cd8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.006076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d0674-5dca-4af9-bcdd-46f49f7f0cd8 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.006724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:17:48.008111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 396/787] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:48.008539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 392/788] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:47 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:48.015022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.015877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c941e9e-2710-4b99-a1e8-4292baea39f2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.016358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c941e9e-2710-4b99-a1e8-4292baea39f2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.016824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c941e9e-2710-4b99-a1e8-4292baea39f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.025797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d047b-2506-4f79-81fc-e4da7c788440 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.030864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.031637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.031922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.032207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.032996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:48.033307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.035065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.038382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-4c941e9e-2710-4b99-a1e8-4292baea39f2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:48.039835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4c941e9e-2710-4b99-a1e8-4292baea39f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:48.040677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 393/789] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:48.047314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.050985 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 397/790] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:48 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:48.058629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee6d4-4c24-494d-9aaf-548d79bdd162 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.063652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3114b-1409-4734-864e-2b027793a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.064454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3114b-1409-4734-864e-2b027793a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.064847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3114b-1409-4734-864e-2b027793a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.065209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3114b-1409-4734-864e-2b027793a4aa admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.065996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3114b-1409-4734-864e-2b027793a4aa admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:48.066422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3114b-1409-4734-864e-2b027793a4aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.068244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3114b-1409-4734-864e-2b027793a4aa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.074118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 394/791] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:48 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:48.078634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c941e9e-2710-4b99-a1e8-4292baea39f2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.088530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c941e9e-2710-4b99-a1e8-4292baea39f2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.093414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a92b5-ad3e-4b43-b915-860d1e61cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.094371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a92b5-ad3e-4b43-b915-860d1e61cc5e admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.094654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a92b5-ad3e-4b43-b915-860d1e61cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.094929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a92b5-ad3e-4b43-b915-860d1e61cc5e admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.095741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a92b5-ad3e-4b43-b915-860d1e61cc5e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.097429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a92b5-ad3e-4b43-b915-860d1e61cc5e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.115565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 398/792] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:17:48 2021] POST /identity/v3/services => generated 251 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:48.732472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175940a-39c6-4f82-a7a0-e9f4de541612 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.733010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175940a-39c6-4f82-a7a0-e9f4de541612 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.733010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175940a-39c6-4f82-a7a0-e9f4de541612 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.735245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 395/793] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:48.741557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628c68a-72da-410b-9d8f-9eeefe5f7d12 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.742025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628c68a-72da-410b-9d8f-9eeefe5f7d12 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.742116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628c68a-72da-410b-9d8f-9eeefe5f7d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.760556 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8628c68a-72da-410b-9d8f-9eeefe5f7d12 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:48.761744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8628c68a-72da-410b-9d8f-9eeefe5f7d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:48.778353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 399/794] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:48 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:48.801825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175940a-39c6-4f82-a7a0-e9f4de541612 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.814525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175940a-39c6-4f82-a7a0-e9f4de541612 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.818924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.819770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.820043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.820307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.821018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.822652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.834291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 03:17:48.835809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 396/795] 10.222.0.58 () {56 vars in 1154 bytes} [Fri Aug 27 03:17:48 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:48.842435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628c68a-72da-410b-9d8f-9eeefe5f7d12 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.851969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628c68a-72da-410b-9d8f-9eeefe5f7d12 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.856647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.857307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.857580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.857848 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.858560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:48.858858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.860575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.865946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 400/796] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:48 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:48.872163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.882635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0232-7323-4be1-b84c-709790f123a4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.887134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.887818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.888093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.888364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.889068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:48.889367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.891014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.896623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 397/797] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:48 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:48.902990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.913061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a383-beb6-4d77-affe-0d960dbd1f4c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.917654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333d39-7d03-4184-9ef6-f3796304cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.918359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333d39-7d03-4184-9ef6-f3796304cce8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.918638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333d39-7d03-4184-9ef6-f3796304cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.918908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333d39-7d03-4184-9ef6-f3796304cce8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.919783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333d39-7d03-4184-9ef6-f3796304cce8 admin admin] RBAC: Adding query filter params (interface=public, service_id=dc663fb35c854df6b52b83facc7c5b14, region_id=RegionOne) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:48.920091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333d39-7d03-4184-9ef6-f3796304cce8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.921683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333d39-7d03-4184-9ef6-f3796304cce8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.927735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 401/798] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:17:48 2021] GET /identity/v3/endpoints?service_id=dc663fb35c854df6b52b83facc7c5b14&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:48.934041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:48.944081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11a0a-5ba4-4371-be61-6eb05aa63c6f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:48.948649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c76339-6705-4f5c-95e7-68980c584ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:48.949350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c76339-6705-4f5c-95e7-68980c584ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:48.949623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c76339-6705-4f5c-95e7-68980c584ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:48.949939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c76339-6705-4f5c-95e7-68980c584ea4 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:48.950618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c76339-6705-4f5c-95e7-68980c584ea4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:48.952300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c76339-6705-4f5c-95e7-68980c584ea4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:48.959091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 398/799] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:17:48 2021] GET /identity/v3/services => generated 1268 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:17:50.222988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06dc3d-45a9-40ac-a09b-19f819df5221 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.223753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06dc3d-45a9-40ac-a09b-19f819df5221 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.223753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06dc3d-45a9-40ac-a09b-19f819df5221 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.225600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 402/800] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:50.231716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8227b-62c4-48fa-9896-9c2775412eda None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.232227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8227b-62c4-48fa-9896-9c2775412eda None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.232381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8227b-62c4-48fa-9896-9c2775412eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.250215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d0e8227b-62c4-48fa-9896-9c2775412eda None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:50.251567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d0e8227b-62c4-48fa-9896-9c2775412eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:50.259626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 399/801] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:50 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:50.259867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82755-f4ed-49b7-a9b3-ac126f59ec0e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.260031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82755-f4ed-49b7-a9b3-ac126f59ec0e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.260182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82755-f4ed-49b7-a9b3-ac126f59ec0e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.262148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 403/802] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:50.269283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe733e1-28ab-430b-b64d-4f567499a41e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.269572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe733e1-28ab-430b-b64d-4f567499a41e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.269853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe733e1-28ab-430b-b64d-4f567499a41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.288641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82755-f4ed-49b7-a9b3-ac126f59ec0e None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.290099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7fe733e1-28ab-430b-b64d-4f567499a41e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:50.291332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7fe733e1-28ab-430b-b64d-4f567499a41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:50.300013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 400/803] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:50 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:50.302098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82755-f4ed-49b7-a9b3-ac126f59ec0e None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.306650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.307529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.308124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.308397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.320321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:50.324997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe733e1-28ab-430b-b64d-4f567499a41e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.327726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:17:50.329314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 404/804] 10.222.0.58 () {56 vars in 1142 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:50.335095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe733e1-28ab-430b-b64d-4f567499a41e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.335828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.340036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667debdf-9bd7-486f-bec3-56ce5d4cac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.340700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667debdf-9bd7-486f-bec3-56ce5d4cac5d admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.340986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667debdf-9bd7-486f-bec3-56ce5d4cac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.341261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667debdf-9bd7-486f-bec3-56ce5d4cac5d admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.342005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667debdf-9bd7-486f-bec3-56ce5d4cac5d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.343727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667debdf-9bd7-486f-bec3-56ce5d4cac5d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.347221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e832-84b8-4a08-9592-c3e5f3d8a737 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.353034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.353882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.354410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.354884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.355955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.356405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.358146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.361085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 401/805] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:17:50 2021] POST /identity/v3/services => generated 241 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:50.368117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 405/806] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:50.374839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cdca-a6f0-4dfd-a7b7-38b3a372ac6f None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.375106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.375614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cdca-a6f0-4dfd-a7b7-38b3a372ac6f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.376173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75cdca-a6f0-4dfd-a7b7-38b3a372ac6f None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.383471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 402/807] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:50 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:50.385434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de46a-b470-43fa-a17a-cfb44b3f4717 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.385798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de46a-b470-43fa-a17a-cfb44b3f4717 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.386143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de46a-b470-43fa-a17a-cfb44b3f4717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.387504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130242c-a3bf-47dc-8c90-d1b2b21b2662 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.403673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.404799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.405259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.405769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.412669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2a5de46a-b470-43fa-a17a-cfb44b3f4717 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:50.413991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2a5de46a-b470-43fa-a17a-cfb44b3f4717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:50.417804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.420064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.427378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 403/808] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:50 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:50.446831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:50.448943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 406/809] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:50.454068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5de46a-b470-43fa-a17a-cfb44b3f4717 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.456592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.461294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5de46a-b470-43fa-a17a-cfb44b3f4717 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.467159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.468068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.468352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.468560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5a18-db96-461f-b914-65eb57587f43 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.468738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.469355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.471289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.474362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.475280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.475781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.476228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.477139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.477620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.479465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.484740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 03:17:50.487436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 404/810] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:50.496703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.497694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 407/811] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:50.504510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.508029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f727a-32d6-4115-9624-7c56fc1c9324 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.513917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.514692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.515046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.515421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.516321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.516568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de72f2-30d8-4b23-8147-98422d274934 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.516869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.518686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.523844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.524677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.524981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.525255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.533802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 405/812] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:50.536682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.542805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.544909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.551378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15fb66-3065-4fd9-aeb2-0b03e0728577 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.556146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.556872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.557111 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.557386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.558413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.558721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.560402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.561994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:17:50.563827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 408/813] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:50.566737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 406/814] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:50.571110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.573642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.582565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf50b8e-0f7f-43c2-86ef-0e5498182d68 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.585251 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156df09-fc35-44bf-a939-e8ea591fc851 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.587375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.588061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.588344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.588617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.589464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.589766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.589934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.590584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.590866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.591141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.592161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.592263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] RBAC: Adding query filter params (interface=public, service_id=d5426569ff8d434cb540c1a45f41b1a7, region_id=RegionOne) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.592263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.593939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.602910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 407/815] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/endpoints?service_id=d5426569ff8d434cb540c1a45f41b1a7&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:50.608840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.615988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 409/816] 10.222.0.58 () {56 vars in 1171 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:50.622157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.623017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02377f-b6c3-4f0b-b43d-e0d1bcbb4275 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.630086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.631771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.632062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.632504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.633207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.634529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b81c7-6803-463e-a588-40b5eaf29303 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.634852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.639890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.641029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.641664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.641664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.641806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 408/817] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/services => generated 1497 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:17:50.653393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.655381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.675857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:50.677522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 410/818] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:50.684196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.694611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d25c9-56ad-4f71-b933-0096cdfb7167 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.699513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.700254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.700538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.700814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.701620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.701930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.704054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.717789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 409/819] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:50.724334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.736110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf17b-e6ea-45ec-9343-4f9a11b90c71 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.741139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.742180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.742612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.743025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.752005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.754234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.769019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:50.770892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 411/820] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:50.777536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.788266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed4fcb-d82c-4438-8edf-aaa6fce017af admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.793198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13d033-306f-4277-8808-80d3afa84546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.793929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d033-306f-4277-8808-80d3afa84546 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.794211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d033-306f-4277-8808-80d3afa84546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.794484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13d033-306f-4277-8808-80d3afa84546 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.795382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13d033-306f-4277-8808-80d3afa84546 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:50.795702 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13d033-306f-4277-8808-80d3afa84546 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.798224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13d033-306f-4277-8808-80d3afa84546 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.812263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 410/821] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:50.819530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:50.831641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef8d9a-3cad-4b0e-9d4d-e4b47cff9756 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:50.836259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ffb7b-ee13-4f5a-b4f8-37ca280085f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:50.837153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ffb7b-ee13-4f5a-b4f8-37ca280085f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:50.837432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ffb7b-ee13-4f5a-b4f8-37ca280085f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:50.837706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ffb7b-ee13-4f5a-b4f8-37ca280085f4 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/0d95b35088f34ce3b36e94f47ef389c0/roles/c1852650b3b54f34ab1f91b15bea4cd5` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:50.839936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ffb7b-ee13-4f5a-b4f8-37ca280085f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=0d95b35088f34ce3b36e94f47ef389c0, role_id=c1852650b3b54f34ab1f91b15bea4cd5)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:50.842724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ffb7b-ee13-4f5a-b4f8-37ca280085f4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:50.857771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 412/822] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:17:50 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/0d95b35088f34ce3b36e94f47ef389c0/roles/c1852650b3b54f34ab1f91b15bea4cd5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:17:51.133287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878dfe-1acc-4029-a2a4-18a833018be7 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:51.133941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878dfe-1acc-4029-a2a4-18a833018be7 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:51.134436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1878dfe-1acc-4029-a2a4-18a833018be7 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:51.136736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 411/823] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:51.143049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9914fc-df6a-4c4c-9ae2-2d7f647f716a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:51.143629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9914fc-df6a-4c4c-9ae2-2d7f647f716a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:51.144121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9914fc-df6a-4c4c-9ae2-2d7f647f716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:51.161963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1c9914fc-df6a-4c4c-9ae2-2d7f647f716a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:51.163525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1c9914fc-df6a-4c4c-9ae2-2d7f647f716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:51.225126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 413/824] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:51 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:51.250012 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878dfe-1acc-4029-a2a4-18a833018be7 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:51.263554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1878dfe-1acc-4029-a2a4-18a833018be7 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:51.268727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:51.269763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:51.270258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:51.270726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:51.271669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:51.273531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:51.286574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 03:17:51.288119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 412/825] 10.222.0.58 () {56 vars in 1154 bytes} [Fri Aug 27 03:17:51 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:51.297052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9914fc-df6a-4c4c-9ae2-2d7f647f716a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:51.306649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9914fc-df6a-4c4c-9ae2-2d7f647f716a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:51.311883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:51.313064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:51.313681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:51.314196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:51.315121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:51.315707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:51.317562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:51.327458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 414/826] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:51 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:51.329999 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:51.340702 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba538a2-50d4-45c9-acf8-269e89d29110 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:51.347290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920d0eb-7569-4e7b-809a-3fb534ab7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:51.348849 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d0eb-7569-4e7b-809a-3fb534ab7310 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:51.349390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d0eb-7569-4e7b-809a-3fb534ab7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:51.349864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920d0eb-7569-4e7b-809a-3fb534ab7310 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:51.350853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d0eb-7569-4e7b-809a-3fb534ab7310 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:51.351390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d0eb-7569-4e7b-809a-3fb534ab7310 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:51.353301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920d0eb-7569-4e7b-809a-3fb534ab7310 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:51.365405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 413/827] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:51 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:51.367114 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:51.383285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419d9d1-6674-401e-9b47-2ffdac0136a0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:51.388381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102e679-e4b4-4327-9e75-ed35d9d29832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:51.394669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102e679-e4b4-4327-9e75-ed35d9d29832 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:51.395230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102e679-e4b4-4327-9e75-ed35d9d29832 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:51.395744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102e679-e4b4-4327-9e75-ed35d9d29832 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:51.396738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102e679-e4b4-4327-9e75-ed35d9d29832 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:51.398646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102e679-e4b4-4327-9e75-ed35d9d29832 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:51.427553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 415/828] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:17:51 2021] POST /identity/v3/endpoints => generated 347 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:17:52.621901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390fdcc-2856-4de9-9e23-d6b19ef17b90 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.622957 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390fdcc-2856-4de9-9e23-d6b19ef17b90 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.623467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390fdcc-2856-4de9-9e23-d6b19ef17b90 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.626161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 414/829] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:52.632733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05889875-779f-4556-971b-f97da411990c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.633593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05889875-779f-4556-971b-f97da411990c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.634078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05889875-779f-4556-971b-f97da411990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.653190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-05889875-779f-4556-971b-f97da411990c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:52.654689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-05889875-779f-4556-971b-f97da411990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:52.679383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 416/830] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:52 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:52.700257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390fdcc-2856-4de9-9e23-d6b19ef17b90 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:52.714016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390fdcc-2856-4de9-9e23-d6b19ef17b90 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:52.719269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:52.720465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.720947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.721435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.722302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:52.724296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:52.736916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:17:52.743469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 415/831] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:52.745909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05889875-779f-4556-971b-f97da411990c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:52.756359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05889875-779f-4556-971b-f97da411990c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:52.761631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:52.762676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.763160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.763666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.764638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:52.765182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:52.767869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:52.779653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 417/832] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:52.782236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:52.793653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e54a5-601f-45ae-b0ed-120fd35fa69e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:52.799623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762baea9-4852-4532-866d-6347f1d6675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:52.800577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baea9-4852-4532-866d-6347f1d6675e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.801061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baea9-4852-4532-866d-6347f1d6675e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.801554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baea9-4852-4532-866d-6347f1d6675e admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.802491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762baea9-4852-4532-866d-6347f1d6675e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:52.803003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762baea9-4852-4532-866d-6347f1d6675e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:52.804901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762baea9-4852-4532-866d-6347f1d6675e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:52.815457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 416/833] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:52.819096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:52.830235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0edad-217b-4a2d-a754-9a98b42b2a07 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:52.835287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:52.836211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.836715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.837211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.838214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] RBAC: Adding query filter params (interface=public, service_id=107e5665c45147c28d1c0ebec8fc9cb3, region_id=RegionOne) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:52.838735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:52.840543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:52.846300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b72a-f073-40ce-ba8c-e588dbcbd52a None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.846851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b72a-f073-40ce-ba8c-e588dbcbd52a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.847161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 418/834] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/endpoints?service_id=107e5665c45147c28d1c0ebec8fc9cb3&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:52.851634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4b72a-f073-40ce-ba8c-e588dbcbd52a None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.853542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 417/835] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:52 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:52.855598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:52.861444 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc6ef6-9deb-42a9-9a7a-eef52f90adfc None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.861733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc6ef6-9deb-42a9-9a7a-eef52f90adfc None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.862010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc6ef6-9deb-42a9-9a7a-eef52f90adfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.866263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374752b8-cb49-4846-834d-4c71c45d1ef1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:52.871016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:52.871906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.872430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.872907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.873865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:52.875767 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:52.882231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-28bc6ef6-9deb-42a9-9a7a-eef52f90adfc None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:52.882690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 419/836] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:17:52.884638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-28bc6ef6-9deb-42a9-9a7a-eef52f90adfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:52.899603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 418/837] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:52 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:52.925273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:52.936001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda34b73-f3d2-4630-8804-4d1ae047723c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:52.941583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:52.942421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.942703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.942979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.943696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:52.945350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:52.957909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 03:17:52.963490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 420/838] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:52.966541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc6ef6-9deb-42a9-9a7a-eef52f90adfc None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:52.976402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc6ef6-9deb-42a9-9a7a-eef52f90adfc None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:52.981421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:52.982177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:52.982556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:52.982891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:52.983739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:52.984109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:52.985910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:52.991826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 419/839] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:52.998412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.011729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07612c32-5a27-4782-9383-d0be3534c8bc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.017979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dced8-a143-4b99-a09b-b4af2f3b3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.019050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dced8-a143-4b99-a09b-b4af2f3b3a36 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.019612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dced8-a143-4b99-a09b-b4af2f3b3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.020100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dced8-a143-4b99-a09b-b4af2f3b3a36 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.021059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dced8-a143-4b99-a09b-b4af2f3b3a36 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.021624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dced8-a143-4b99-a09b-b4af2f3b3a36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.023706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dced8-a143-4b99-a09b-b4af2f3b3a36 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.035517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 421/840] 10.222.0.58 () {56 vars in 1136 bytes} [Fri Aug 27 03:17:52 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:53.038328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.050211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae28a45-7a2b-4255-9b38-1a80ea5a8af0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.055525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5e5e2-b786-4616-96bd-cc05cf0a7003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.056521 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e5e2-b786-4616-96bd-cc05cf0a7003 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.057027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e5e2-b786-4616-96bd-cc05cf0a7003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.057500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e5e2-b786-4616-96bd-cc05cf0a7003 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.058772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5e5e2-b786-4616-96bd-cc05cf0a7003 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.060104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-60e5e5e2-b786-4616-96bd-cc05cf0a7003 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:17:53.060104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:17:53.060104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:17:53.061357 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5e5e2-b786-4616-96bd-cc05cf0a7003 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.091449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 420/841] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:17:53 2021] POST /identity/v3/endpoints => generated 346 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:17:53.093859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353da0-0faf-415e-a9e1-fdf0a87c0a25 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.094223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353da0-0faf-415e-a9e1-fdf0a87c0a25 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.094501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353da0-0faf-415e-a9e1-fdf0a87c0a25 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.096664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 422/842] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:53.104433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be07f-87c1-46ac-937f-5e9b07dfa600 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.105033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be07f-87c1-46ac-937f-5e9b07dfa600 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.105540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be07f-87c1-46ac-937f-5e9b07dfa600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.126261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2f8be07f-87c1-46ac-937f-5e9b07dfa600 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:53.127879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2f8be07f-87c1-46ac-937f-5e9b07dfa600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:53.146549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 421/843] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:53 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:53.170994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353da0-0faf-415e-a9e1-fdf0a87c0a25 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.188912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353da0-0faf-415e-a9e1-fdf0a87c0a25 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.193643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.194526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.194806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.195130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.208930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:17:53.216693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:17:53.218356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 423/844] 10.222.0.58 () {56 vars in 1142 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:53.225030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be07f-87c1-46ac-937f-5e9b07dfa600 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.234997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be07f-87c1-46ac-937f-5e9b07dfa600 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.239811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.240537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.240821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.241139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.241907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.242206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.243958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.254079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 422/845] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:53.260589 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.271894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff5e5e-af35-48c4-ba55-cae3981f064a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.276794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.277645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.277928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.278252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.290545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.292476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.311710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:53.313470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 424/846] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:53.320143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.332429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c74f8-d670-4453-82f4-e1f22332a4a2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.337524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.338186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.338462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.338730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.339512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.339804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.341404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.354595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 423/847] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:53.360841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.376022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7878e6-29de-478e-a090-bd07c74c15c4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.380660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.381477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.381755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.382027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.390002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.392487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.407558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 03:17:53.409149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 425/848] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:53.415585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.426044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac857d-cbdb-40b8-8bb3-58682b9c4245 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.430878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.431696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.432044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.432422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.433690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.434064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.436098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.459550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 424/849] 10.222.0.58 () {56 vars in 1171 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:53.462046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.472409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a438-4447-4508-9cab-224fc2d4f7b4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.477091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.477789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.478123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.478397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.486645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.488492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.502311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 426/850] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:17:53.504610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.514564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f7392-1e09-4cf9-b588-eb0d94b00045 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.519763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.520601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.520881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.521153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.531936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.533989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.551064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:17:53.557528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 425/851] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:53.559223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.569833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fdc26-ad92-4a53-9e38-ade8b334680e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.575170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.576083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.576373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.576644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.577405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.577710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.579622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.597065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 427/852] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:53.598750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.608813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2f14-318b-4dc0-b693-f077d0648f6a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.613663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.614550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.614835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.615160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.622576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.624641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.639177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:53.646348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 426/853] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:17:53.647855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.658505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56248cdb-d14e-434b-ab9a-00d111b918dc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.663268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992354e-c065-4f75-aa64-3395c6379240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.664033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992354e-c065-4f75-aa64-3395c6379240 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.664366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992354e-c065-4f75-aa64-3395c6379240 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.664645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992354e-c065-4f75-aa64-3395c6379240 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.665504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992354e-c065-4f75-aa64-3395c6379240 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.665814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992354e-c065-4f75-aa64-3395c6379240 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.667765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992354e-c065-4f75-aa64-3395c6379240 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.681223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 428/854] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:53.688831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.699664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf6fa-36b2-408b-920d-5936a7944688 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.704995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80336-7a4f-4bf0-babb-560215ae68a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.705817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80336-7a4f-4bf0-babb-560215ae68a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.706108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80336-7a4f-4bf0-babb-560215ae68a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.706385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80336-7a4f-4bf0-babb-560215ae68a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.707268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80336-7a4f-4bf0-babb-560215ae68a3 admin admin] RBAC: Adding query filter params (role.id=c1852650b3b54f34ab1f91b15bea4cd5, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=0d95b35088f34ce3b36e94f47ef389c0) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.707613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80336-7a4f-4bf0-babb-560215ae68a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.709631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80336-7a4f-4bf0-babb-560215ae68a3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.719502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 427/855] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/role_assignments?user.id=0d95b35088f34ce3b36e94f47ef389c0&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=c1852650b3b54f34ab1f91b15bea4cd5 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:53.724652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6238c8-2616-444a-8e98-ca617964c5c0 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.724933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6238c8-2616-444a-8e98-ca617964c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.725195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6238c8-2616-444a-8e98-ca617964c5c0 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.727154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 429/856] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:53.733760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509ba2-5aaa-40ed-9e92-f5cecd23e925 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.734078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509ba2-5aaa-40ed-9e92-f5cecd23e925 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.734472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de509ba2-5aaa-40ed-9e92-f5cecd23e925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.755387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-de509ba2-5aaa-40ed-9e92-f5cecd23e925 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:53.755387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-de509ba2-5aaa-40ed-9e92-f5cecd23e925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:53.763797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 428/857] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:53 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:53.787842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6238c8-2616-444a-8e98-ca617964c5c0 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.801075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6238c8-2616-444a-8e98-ca617964c5c0 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.805903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.806820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.807148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.807493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.808525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.811072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.827716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 03:17:53.829491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 430/858] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/services/compute => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:53.837089 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de509ba2-5aaa-40ed-9e92-f5cecd23e925 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.847021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de509ba2-5aaa-40ed-9e92-f5cecd23e925 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.851833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb881d4-4022-44ff-9b6f-062149890121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.852591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb881d4-4022-44ff-9b6f-062149890121 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.852936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb881d4-4022-44ff-9b6f-062149890121 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.853277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb881d4-4022-44ff-9b6f-062149890121 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.854069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb881d4-4022-44ff-9b6f-062149890121 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.854457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb881d4-4022-44ff-9b6f-062149890121 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.856187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb881d4-4022-44ff-9b6f-062149890121 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.862314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 429/859] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:53.868918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:53.880379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e559f-5c8d-4719-a41f-95b0266d5f82 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:53.885473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9341528-aa0a-4a00-9749-2e3bc7dfd94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:53.886452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9341528-aa0a-4a00-9749-2e3bc7dfd94c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:53.886928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9341528-aa0a-4a00-9749-2e3bc7dfd94c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:53.887385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9341528-aa0a-4a00-9749-2e3bc7dfd94c admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:53.888290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9341528-aa0a-4a00-9749-2e3bc7dfd94c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:53.888772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9341528-aa0a-4a00-9749-2e3bc7dfd94c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:53.890883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9341528-aa0a-4a00-9749-2e3bc7dfd94c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:53.901393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 431/860] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:53 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:55.172975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8d17-1c6c-4900-b947-9e036b7c384f None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.173523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8d17-1c6c-4900-b947-9e036b7c384f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.173523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8d17-1c6c-4900-b947-9e036b7c384f None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.175670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 430/861] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:55.183944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91e80b-6b28-4532-8c7f-de46682111db None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.184924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91e80b-6b28-4532-8c7f-de46682111db None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.185214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91e80b-6b28-4532-8c7f-de46682111db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.206876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-cc91e80b-6b28-4532-8c7f-de46682111db None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:55.208107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-cc91e80b-6b28-4532-8c7f-de46682111db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:55.216281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 432/862] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:55 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:55.240853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8d17-1c6c-4900-b947-9e036b7c384f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:55.253779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8d17-1c6c-4900-b947-9e036b7c384f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:55.258499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:55.259334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.259653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.259928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.260603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:55.262263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:55.274905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:17:55.276563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 431/863] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:55 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:55.283712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91e80b-6b28-4532-8c7f-de46682111db None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:55.293219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91e80b-6b28-4532-8c7f-de46682111db None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:55.298211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34057d7c-759d-443c-a98e-618e9f502013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:55.298886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34057d7c-759d-443c-a98e-618e9f502013 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.299167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34057d7c-759d-443c-a98e-618e9f502013 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.299488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34057d7c-759d-443c-a98e-618e9f502013 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.300211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34057d7c-759d-443c-a98e-618e9f502013 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:55.300517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34057d7c-759d-443c-a98e-618e9f502013 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:55.302131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34057d7c-759d-443c-a98e-618e9f502013 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:55.308057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 433/864] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:55 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:55.317999 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:55.327962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362309-6d04-4740-bba4-d55f2fac659b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:55.332754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:55.333416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.333699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.333977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.334694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:55.335001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:55.336653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:55.342197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 432/865] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:55 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:55.343872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134c8d-f7b3-447f-934e-5e30d3678ffa None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.344162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134c8d-f7b3-447f-934e-5e30d3678ffa None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.344439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134c8d-f7b3-447f-934e-5e30d3678ffa None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.346406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 434/866] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:55.349130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:55.352137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680fd9-9a9c-40eb-954f-ebffcba77765 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.352422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680fd9-9a9c-40eb-954f-ebffcba77765 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.352694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680fd9-9a9c-40eb-954f-ebffcba77765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.359071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856b44-f027-4c3a-989c-7427806de036 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:55.364151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:55.364806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.365091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.365370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.366114 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:55.367770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:55.371320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-2c680fd9-9a9c-40eb-954f-ebffcba77765 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:55.372785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2c680fd9-9a9c-40eb-954f-ebffcba77765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:55.381455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 435/867] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:55 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:55.388541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 433/868] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:17:55 2021] POST /identity/v3/endpoints => generated 349 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:55.407173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680fd9-9a9c-40eb-954f-ebffcba77765 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:55.417294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c680fd9-9a9c-40eb-954f-ebffcba77765 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:55.433995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:55.435038 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.435540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.436033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.436942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:55.439150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:55.440932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.common [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 03:17:55.462761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.sql.core [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 03:17:55.462761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 03:17:55.462761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [parameters: {'id': '1ea9c8268b4d4030b43b450e9120470b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 03:17:55.462761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 03:17:55.479537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ea9c8268b4d4030b43b450e9120470b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ea9c8268b4d4030b43b450e9120470b. Aug 27 03:17:55.481886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 436/869] 10.222.0.58 () {60 vars in 1162 bytes} [Fri Aug 27 03:17:55 2021] POST /identity/v3/projects => generated 262 bytes in 75 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:55.489205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:55.501984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39328d-027a-4458-a337-2bebe2084241 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:55.507004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ffa8-128a-4f47-8fed-41b951984295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:55.508424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ffa8-128a-4f47-8fed-41b951984295 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.509047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ffa8-128a-4f47-8fed-41b951984295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.509518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ffa8-128a-4f47-8fed-41b951984295 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.518903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ffa8-128a-4f47-8fed-41b951984295 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:55.521440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ffa8-128a-4f47-8fed-41b951984295 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:55.538094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-58b5ffa8-128a-4f47-8fed-41b951984295 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:17:55.540108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 434/870] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:55.547251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:55.559935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceb059-fad8-4717-a550-a57d223c7b80 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:55.565182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdd945-a04f-4a7f-9f0a-57246e1a820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:55.565838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdd945-a04f-4a7f-9f0a-57246e1a820e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.566117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdd945-a04f-4a7f-9f0a-57246e1a820e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.566382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdd945-a04f-4a7f-9f0a-57246e1a820e admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.567186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdd945-a04f-4a7f-9f0a-57246e1a820e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:55.567537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdd945-a04f-4a7f-9f0a-57246e1a820e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:55.570258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdd945-a04f-4a7f-9f0a-57246e1a820e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:55.592580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 437/871] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:55 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:55.963505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3f0f-7cab-4200-88db-b9f5a7a08daf None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.963793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3f0f-7cab-4200-88db-b9f5a7a08daf None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.964071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3f0f-7cab-4200-88db-b9f5a7a08daf None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.966135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 435/872] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:55.972652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf5c2-c9b6-4330-ab99-2ba5c44b8fec None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:55.972946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf5c2-c9b6-4330-ab99-2ba5c44b8fec None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:55.973229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf5c2-c9b6-4330-ab99-2ba5c44b8fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:55.994180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e4cdf5c2-c9b6-4330-ab99-2ba5c44b8fec None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:55.995762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e4cdf5c2-c9b6-4330-ab99-2ba5c44b8fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:56.004705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 438/873] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:55 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:56.028647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3f0f-7cab-4200-88db-b9f5a7a08daf None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:56.042207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3f0f-7cab-4200-88db-b9f5a7a08daf None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:56.046924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:56.047914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:56.048195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:56.048467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:56.049141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:56.051095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:56.063097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 03:17:56.064784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 436/874] 10.222.0.58 () {56 vars in 1127 bytes} [Fri Aug 27 03:17:56 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:56.071603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf5c2-c9b6-4330-ab99-2ba5c44b8fec None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:56.081047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf5c2-c9b6-4330-ab99-2ba5c44b8fec None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:56.085706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dfc75-3ff7-4719-889e-6783f69bb83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:56.086373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dfc75-3ff7-4719-889e-6783f69bb83d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:56.086654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dfc75-3ff7-4719-889e-6783f69bb83d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:56.086981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dfc75-3ff7-4719-889e-6783f69bb83d admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:56.087777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dfc75-3ff7-4719-889e-6783f69bb83d admin admin] RBAC: Adding query filter params (name=image) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:56.088082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dfc75-3ff7-4719-889e-6783f69bb83d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:56.089749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dfc75-3ff7-4719-889e-6783f69bb83d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:56.095335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 439/875] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:56 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:56.101640 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:56.108878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be19d-0f3f-48c9-97ff-2d8a6ea35940 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:56.109205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be19d-0f3f-48c9-97ff-2d8a6ea35940 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:56.109604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be19d-0f3f-48c9-97ff-2d8a6ea35940 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:56.111790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 440/876] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:56.113358 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50984923-7434-422f-b983-32c5bfaeeb58 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:56.117638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cfd9a-9514-462a-866b-f461da5669c3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:56.117922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cfd9a-9514-462a-866b-f461da5669c3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:56.118128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:56.118282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cfd9a-9514-462a-866b-f461da5669c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:56.118848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:56.119137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:56.119557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:56.120279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] RBAC: Adding query filter params (type=image) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:56.120588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:56.122336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:56.128028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 437/877] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:17:56 2021] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:56.136666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-643cfd9a-9514-462a-866b-f461da5669c3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:56.137969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-643cfd9a-9514-462a-866b-f461da5669c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:56.151498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 441/878] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:56 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:56.171056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:56.181646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5689491-63c3-4580-9844-9165319e8b5a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:56.186770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317f4ba-627b-4488-93eb-c93b54d52093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:56.187532 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317f4ba-627b-4488-93eb-c93b54d52093 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:56.187898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317f4ba-627b-4488-93eb-c93b54d52093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:56.188354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317f4ba-627b-4488-93eb-c93b54d52093 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:56.189250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317f4ba-627b-4488-93eb-c93b54d52093 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:56.190935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317f4ba-627b-4488-93eb-c93b54d52093 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:56.208403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 438/879] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:17:56 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:17:57.558324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61fd94-80d0-4314-80dd-d0e915e49873 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.558913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61fd94-80d0-4314-80dd-d0e915e49873 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.558913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61fd94-80d0-4314-80dd-d0e915e49873 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.560965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 442/880] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:57.567697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98f71-12e0-4b44-b72b-79d3e70efe51 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.568183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98f71-12e0-4b44-b72b-79d3e70efe51 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.568407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a98f71-12e0-4b44-b72b-79d3e70efe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.586686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f3a98f71-12e0-4b44-b72b-79d3e70efe51 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:57.587912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f3a98f71-12e0-4b44-b72b-79d3e70efe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:57.604140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 439/881] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:57 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:57.628245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61fd94-80d0-4314-80dd-d0e915e49873 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.640788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61fd94-80d0-4314-80dd-d0e915e49873 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:57.645339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:57.646079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.646359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.646632 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.647293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:57.648929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:57.660249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:17:57.667214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 443/882] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:17:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:57.668596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a98f71-12e0-4b44-b72b-79d3e70efe51 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.677815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a98f71-12e0-4b44-b72b-79d3e70efe51 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:57.682543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:57.683547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.683831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.684106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.684825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:57.685133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:57.686732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:57.695464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 440/883] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:57.698335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.708231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff634a8-4475-4a82-8340-2cc367dbcf34 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:57.712989 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:57.713643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.713922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.714195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.714916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:57.715222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:57.716879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:57.723635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 444/884] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:17:57 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:57.730382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.741096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981c9b7-8541-47dd-9ae8-520431fbf186 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:57.746032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8924c86-11cf-4a64-bde4-194357e6130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:57.746711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924c86-11cf-4a64-bde4-194357e6130d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.746989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924c86-11cf-4a64-bde4-194357e6130d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.747262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924c86-11cf-4a64-bde4-194357e6130d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.748144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8924c86-11cf-4a64-bde4-194357e6130d admin admin] RBAC: Adding query filter params (interface=admin, service_id=107e5665c45147c28d1c0ebec8fc9cb3, region_id=RegionOne) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:57.748460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8924c86-11cf-4a64-bde4-194357e6130d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:57.750613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8924c86-11cf-4a64-bde4-194357e6130d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:57.759458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 441/885] 10.222.0.58 () {56 vars in 1271 bytes} [Fri Aug 27 03:17:57 2021] GET /identity/v3/endpoints?service_id=107e5665c45147c28d1c0ebec8fc9cb3&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:57.763550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.773508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e6107-c5f3-4bd7-91f3-543e77828340 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:57.778205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cf15-3938-47f8-a7c4-2dc7d04ed048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:57.778870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cf15-3938-47f8-a7c4-2dc7d04ed048 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.779147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cf15-3938-47f8-a7c4-2dc7d04ed048 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.779449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cf15-3938-47f8-a7c4-2dc7d04ed048 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.780137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cf15-3938-47f8-a7c4-2dc7d04ed048 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:57.781902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cf15-3938-47f8-a7c4-2dc7d04ed048 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:57.795507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 445/886] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:17:57 2021] GET /identity/v3/services => generated 1727 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:17:57.814912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccfaa-6804-45d4-aca4-295832f4e0fb None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.815249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccfaa-6804-45d4-aca4-295832f4e0fb None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.815491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ccfaa-6804-45d4-aca4-295832f4e0fb None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.817744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 442/887] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:57.823940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561c894-0855-4b2f-aa2c-594dce77a872 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.824288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561c894-0855-4b2f-aa2c-594dce77a872 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.824567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561c894-0855-4b2f-aa2c-594dce77a872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.844007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3561c894-0855-4b2f-aa2c-594dce77a872 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:57.845319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3561c894-0855-4b2f-aa2c-594dce77a872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:57.854251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 446/888] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:57 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:17:57.880086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccfaa-6804-45d4-aca4-295832f4e0fb None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.894103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ccfaa-6804-45d4-aca4-295832f4e0fb None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:57.898940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:57.899590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.899868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.900188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.900909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:57.902945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:57.904368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.common [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 03:17:57.918942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.sql.core [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 03:17:57.918942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 03:17:57.918942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [parameters: {'user_id': '8f765ace9de14e88941d23cbb4ddc9cc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 03:17:57.918942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73389) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 03:17:57.925517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 03:17:57.927316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 443/889] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:17:57 2021] POST /identity/v3/users => generated 160 bytes in 48 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:57.934637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561c894-0855-4b2f-aa2c-594dce77a872 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.944825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561c894-0855-4b2f-aa2c-594dce77a872 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:57.950019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd3846-563d-4245-8e9e-49b9d7b99483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:57.950891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd3846-563d-4245-8e9e-49b9d7b99483 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:57.951177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd3846-563d-4245-8e9e-49b9d7b99483 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:57.951521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd3846-563d-4245-8e9e-49b9d7b99483 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:57.960182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd3846-563d-4245-8e9e-49b9d7b99483 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:57.962259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd3846-563d-4245-8e9e-49b9d7b99483 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:57.977192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-99dd3846-563d-4245-8e9e-49b9d7b99483 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 03:17:57.978707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 447/890] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:17:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:57.985529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:57.997369 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb437-1654-4797-9860-dd82edf34a66 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:58.002930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8ca70-1b29-46f0-b47a-cc60aba625e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:58.003886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8ca70-1b29-46f0-b47a-cc60aba625e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.004161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8ca70-1b29-46f0-b47a-cc60aba625e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.004427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8ca70-1b29-46f0-b47a-cc60aba625e9 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.005241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8ca70-1b29-46f0-b47a-cc60aba625e9 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:58.005539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8ca70-1b29-46f0-b47a-cc60aba625e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:58.007743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8ca70-1b29-46f0-b47a-cc60aba625e9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:58.047767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 444/891] 10.222.0.58 () {56 vars in 1123 bytes} [Fri Aug 27 03:17:57 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:17:58.390637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801a272-2a1a-4432-88a0-af11a25a7a41 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.391044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801a272-2a1a-4432-88a0-af11a25a7a41 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.391243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801a272-2a1a-4432-88a0-af11a25a7a41 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.393502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 448/892] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:58.401766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6b2a-4e98-43a8-8586-917a3224b51e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.402098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6b2a-4e98-43a8-8586-917a3224b51e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.402353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6b2a-4e98-43a8-8586-917a3224b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.423792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-bd6e6b2a-4e98-43a8-8586-917a3224b51e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:58.425349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-bd6e6b2a-4e98-43a8-8586-917a3224b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:58.433618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 445/893] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:58 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:58.444833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d93d-52b6-4508-85fb-a23080409052 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.445121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d93d-52b6-4508-85fb-a23080409052 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.445401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d93d-52b6-4508-85fb-a23080409052 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.447190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 449/894] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:58.453108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d549-9769-4b36-9013-909ea2f15f5b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.453374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d549-9769-4b36-9013-909ea2f15f5b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.453670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d549-9769-4b36-9013-909ea2f15f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.458498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d93d-52b6-4508-85fb-a23080409052 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:58.471515 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2186d549-9769-4b36-9013-909ea2f15f5b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:17:58.472689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2186d549-9769-4b36-9013-909ea2f15f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:17:58.473647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d93d-52b6-4508-85fb-a23080409052 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:58.478157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:58.478816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.479099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.479396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.480124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:58.483394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 446/895] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:58 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:17:58.483536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:58.496558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 450/896] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:17:58 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:17:58.504582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186d549-9769-4b36-9013-909ea2f15f5b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:58.514596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186d549-9769-4b36-9013-909ea2f15f5b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:58.531760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:58.532583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.532866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.533148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.533823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:58.536130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:58.548471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 03:17:58.549996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 447/897] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:17:58 2021] GET /identity/v3/services/compute => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:17:58.557141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:58.569328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89facf2-766b-4c91-9ee3-137dc1b48048 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:58.574994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:58.575805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.576149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.576493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.577287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:58.577656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:58.579473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:58.585670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 451/898] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:58 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:58.593330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:58.607653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296322e-bc96-4caf-9aa8-8ae177cbb796 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:58.614176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:58.614956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.615310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.615690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.616495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:58.616892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:58.618628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:58.630336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 448/899] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:17:58 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:58.632182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:58.649051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5dd8b-11a4-4d8e-a592-e354fdead711 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:58.659924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd940d4-7d94-4552-a393-3385327a88b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:58.660937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd940d4-7d94-4552-a393-3385327a88b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.661394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd940d4-7d94-4552-a393-3385327a88b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.661838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd940d4-7d94-4552-a393-3385327a88b7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.662825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd940d4-7d94-4552-a393-3385327a88b7 admin admin] RBAC: Adding query filter params (interface=public, service_id=dbd9431de1f94f118f66cf89af368f2f, region_id=RegionOne) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:17:58.664080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd940d4-7d94-4552-a393-3385327a88b7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:58.665749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd940d4-7d94-4552-a393-3385327a88b7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:58.674317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 452/900] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:17:58 2021] GET /identity/v3/endpoints?service_id=dbd9431de1f94f118f66cf89af368f2f&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:17:58.681149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:17:58.692375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed277a8-cfce-4981-8e6b-04c48022767f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:17:58.700844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c6d9b-34d9-4a84-92e5-2f94fa6d30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:17:58.701628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6d9b-34d9-4a84-92e5-2f94fa6d30ea admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:58.702029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6d9b-34d9-4a84-92e5-2f94fa6d30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:58.702402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6d9b-34d9-4a84-92e5-2f94fa6d30ea admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:58.704479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c6d9b-34d9-4a84-92e5-2f94fa6d30ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:17:58.705562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c6d9b-34d9-4a84-92e5-2f94fa6d30ea admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:17:58.713650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 449/901] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:17:58 2021] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:17:59.989062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038371-b013-448a-89a0-27670a232153 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:59.989628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038371-b013-448a-89a0-27670a232153 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:59.989628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038371-b013-448a-89a0-27670a232153 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:17:59.991428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 453/902] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:17:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:17:59.997621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65d2bd-9ea5-4a01-b782-cb1e57b2e20e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:17:59.998044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65d2bd-9ea5-4a01-b782-cb1e57b2e20e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:17:59.998241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65d2bd-9ea5-4a01-b782-cb1e57b2e20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.017589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5b65d2bd-9ea5-4a01-b782-cb1e57b2e20e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:00.018782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5b65d2bd-9ea5-4a01-b782-cb1e57b2e20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:00.027031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 450/903] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:17:59 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:00.055516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038371-b013-448a-89a0-27670a232153 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.068585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038371-b013-448a-89a0-27670a232153 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.073392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.074190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.074468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.074744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.075397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.077010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.089043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 03:18:00.095393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 454/904] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:18:00.097340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65d2bd-9ea5-4a01-b782-cb1e57b2e20e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.106377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65d2bd-9ea5-4a01-b782-cb1e57b2e20e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.111285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.112077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.112425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.112787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.113570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:00.113937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.115649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.122150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 451/905] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:00.128608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.138577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a3e1e-5306-47c9-a769-01f48928ecb5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.143530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4001c6a-ba15-41a2-9258-421ddb6cbceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.144256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4001c6a-ba15-41a2-9258-421ddb6cbceb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.144601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4001c6a-ba15-41a2-9258-421ddb6cbceb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.144938 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4001c6a-ba15-41a2-9258-421ddb6cbceb admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.145712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4001c6a-ba15-41a2-9258-421ddb6cbceb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:00.146081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4001c6a-ba15-41a2-9258-421ddb6cbceb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.147790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4001c6a-ba15-41a2-9258-421ddb6cbceb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.153229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 455/906] 10.222.0.58 () {56 vars in 1144 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:00.159576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.169497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9a7e8-1b44-49e4-b4ac-e7bd2d2ad871 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.174411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4902b20-91d4-4ba6-b8b8-7a8b03d499b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.175058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902b20-91d4-4ba6-b8b8-7a8b03d499b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.175314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902b20-91d4-4ba6-b8b8-7a8b03d499b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.175635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902b20-91d4-4ba6-b8b8-7a8b03d499b5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.176393 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4902b20-91d4-4ba6-b8b8-7a8b03d499b5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.177973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4902b20-91d4-4ba6-b8b8-7a8b03d499b5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.194609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 452/907] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:18:00 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:18:00.694065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c926bf6-f9b8-4bb8-812c-c8353f50a72e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.694347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c926bf6-f9b8-4bb8-812c-c8353f50a72e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.694613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c926bf6-f9b8-4bb8-812c-c8353f50a72e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.696385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 456/908] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:00.702490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93991c-2000-43f6-92ba-77e9afd65890 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.702932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93991c-2000-43f6-92ba-77e9afd65890 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.703463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93991c-2000-43f6-92ba-77e9afd65890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.721674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-da93991c-2000-43f6-92ba-77e9afd65890 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:00.722870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-da93991c-2000-43f6-92ba-77e9afd65890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:00.743380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 453/909] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:00 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:00.764497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c926bf6-f9b8-4bb8-812c-c8353f50a72e None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.776922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c926bf6-f9b8-4bb8-812c-c8353f50a72e None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.781468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.782320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.782665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.782997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.783745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.785381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.795971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 03:18:00.797425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 457/910] 10.222.0.58 () {56 vars in 1127 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:18:00.803932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93991c-2000-43f6-92ba-77e9afd65890 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.813969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93991c-2000-43f6-92ba-77e9afd65890 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.818776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.819465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.819747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.820019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.820735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:00.821040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.822647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.831385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 454/911] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:00.834192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.844991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a5202-3924-4840-aec0-0d253b8073c4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.849908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.850551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.850824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.851063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.851819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] RBAC: Adding query filter params (type=image) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:00.852115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.853660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.859075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 458/912] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:00.865521 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.875478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a55e3d-4f2a-44b2-8ba4-2eeb9dfd6393 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.880409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77443bf-37e2-42b1-a084-57aa2a265d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.881062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77443bf-37e2-42b1-a084-57aa2a265d60 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.881336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77443bf-37e2-42b1-a084-57aa2a265d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.881577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77443bf-37e2-42b1-a084-57aa2a265d60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.882381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77443bf-37e2-42b1-a084-57aa2a265d60 admin admin] RBAC: Adding query filter params (interface=public, service_id=0f9cbbc1b5d4495584ad7a008ce1bcb7, region_id=RegionOne) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:00.882689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77443bf-37e2-42b1-a084-57aa2a265d60 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.884348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77443bf-37e2-42b1-a084-57aa2a265d60 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.890753 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 455/913] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/endpoints?service_id=0f9cbbc1b5d4495584ad7a008ce1bcb7&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:18:00.896846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:00.907067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c008-6f94-4b48-beda-51b821b42cdb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:00.911917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d2e1-fdf4-4a40-bd52-c5e01c1c03e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:00.912600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d2e1-fdf4-4a40-bd52-c5e01c1c03e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.912882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d2e1-fdf4-4a40-bd52-c5e01c1c03e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.913123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d2e1-fdf4-4a40-bd52-c5e01c1c03e6 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.913831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d2e1-fdf4-4a40-bd52-c5e01c1c03e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:00.915511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d2e1-fdf4-4a40-bd52-c5e01c1c03e6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:00.923397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 459/914] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:18:00 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:18:00.974548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb677-2d0b-4e39-a814-09afc81b87d8 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.974854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb677-2d0b-4e39-a814-09afc81b87d8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.975021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb677-2d0b-4e39-a814-09afc81b87d8 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:00.977058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 456/915] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:00.983671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8795b-f638-4d25-a631-70b3b9104fa1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:00.984064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8795b-f638-4d25-a631-70b3b9104fa1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:00.984367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8795b-f638-4d25-a631-70b3b9104fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:01.006052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-05f8795b-f638-4d25-a631-70b3b9104fa1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:01.007291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-05f8795b-f638-4d25-a631-70b3b9104fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:01.017641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 460/916] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:00 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:01.042124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb677-2d0b-4e39-a814-09afc81b87d8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:01.056220 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb677-2d0b-4e39-a814-09afc81b87d8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:01.061559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:01.062643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:01.063072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:01.063415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:01.064093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:01.065721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:01.079169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 03:18:01.083375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 457/917] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:18:01 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:01.087442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8795b-f638-4d25-a631-70b3b9104fa1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:01.096877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8795b-f638-4d25-a631-70b3b9104fa1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:01.101448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:01.102106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:01.102381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:01.102651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:01.103400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:01.103686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:01.105261 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:01.111663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 461/918] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:18:01 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:01.117960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:01.128223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cf72e-c149-4426-ac86-e848bd5719c4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:01.132656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0d48c-6d19-4182-b271-cde9659e43f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:01.133312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d48c-6d19-4182-b271-cde9659e43f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:01.133604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d48c-6d19-4182-b271-cde9659e43f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:01.133858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d48c-6d19-4182-b271-cde9659e43f1 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:01.134563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d48c-6d19-4182-b271-cde9659e43f1 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:01.134867 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d48c-6d19-4182-b271-cde9659e43f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:01.136485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d48c-6d19-4182-b271-cde9659e43f1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:01.141693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 458/919] 10.222.0.58 () {56 vars in 1134 bytes} [Fri Aug 27 03:18:01 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:01.147900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:01.157637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8f6f-2c14-43fb-a1c5-8d8549c784b2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:01.162058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef5fb7-c69b-4357-ab7e-ddc25ddb00d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:01.162701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5fb7-c69b-4357-ab7e-ddc25ddb00d2 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:01.162980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5fb7-c69b-4357-ab7e-ddc25ddb00d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:01.163247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5fb7-c69b-4357-ab7e-ddc25ddb00d2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:01.164016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef5fb7-c69b-4357-ab7e-ddc25ddb00d2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:01.165598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef5fb7-c69b-4357-ab7e-ddc25ddb00d2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:01.185419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 462/920] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:18:01 2021] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:02.366587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fa86d-5355-418d-a4be-60c9f2b876f2 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:02.367140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fa86d-5355-418d-a4be-60c9f2b876f2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:02.367140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fa86d-5355-418d-a4be-60c9f2b876f2 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:02.371387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 459/921] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:02.375560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955d83-d232-4613-956f-f3f14bed7cb1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:02.376005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955d83-d232-4613-956f-f3f14bed7cb1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:02.376080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98955d83-d232-4613-956f-f3f14bed7cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:02.394047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-98955d83-d232-4613-956f-f3f14bed7cb1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:02.395780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-98955d83-d232-4613-956f-f3f14bed7cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:02.415395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 463/922] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:02 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:02.439142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fa86d-5355-418d-a4be-60c9f2b876f2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:02.452207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fa86d-5355-418d-a4be-60c9f2b876f2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:02.456947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d09b5-e397-453f-8a26-eb2b58da2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:02.457933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d09b5-e397-453f-8a26-eb2b58da2d82 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:02.458284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d09b5-e397-453f-8a26-eb2b58da2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:02.458632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d09b5-e397-453f-8a26-eb2b58da2d82 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:02.460079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d09b5-e397-453f-8a26-eb2b58da2d82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:02.461897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d09b5-e397-453f-8a26-eb2b58da2d82 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:02.463907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 460/923] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:02.471176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98955d83-d232-4613-956f-f3f14bed7cb1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:02.480620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98955d83-d232-4613-956f-f3f14bed7cb1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:02.485813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8193b-4caf-4088-befe-73cf8dc61a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:02.486480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8193b-4caf-4088-befe-73cf8dc61a0a admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:02.486764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8193b-4caf-4088-befe-73cf8dc61a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:02.487041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8193b-4caf-4088-befe-73cf8dc61a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:02.487803 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8193b-4caf-4088-befe-73cf8dc61a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:02.489757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8193b-4caf-4088-befe-73cf8dc61a0a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:02.519788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 464/924] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:18:02 2021] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:03.153728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982b3b6-c2c1-4bae-b424-f09f587b8b12 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.154140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982b3b6-c2c1-4bae-b424-f09f587b8b12 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.154238 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982b3b6-c2c1-4bae-b424-f09f587b8b12 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.156126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 461/925] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:03.162542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805eaf-1118-47a6-afa5-1350f32e7b1c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.162807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805eaf-1118-47a6-afa5-1350f32e7b1c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.163107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805eaf-1118-47a6-afa5-1350f32e7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.181853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e8805eaf-1118-47a6-afa5-1350f32e7b1c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:03.183383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e8805eaf-1118-47a6-afa5-1350f32e7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:03.254155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 465/926] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:03 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:03.277774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982b3b6-c2c1-4bae-b424-f09f587b8b12 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.291301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982b3b6-c2c1-4bae-b424-f09f587b8b12 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.296169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.297168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.297501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.297778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.298435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.300078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.311219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 03:18:03.312792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 462/927] 10.222.0.58 () {56 vars in 1127 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:03.319463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805eaf-1118-47a6-afa5-1350f32e7b1c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.328781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805eaf-1118-47a6-afa5-1350f32e7b1c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.333794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.334455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.334739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.335014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.335759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:03.336066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.337678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.342891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 466/928] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:18:03.349146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.359813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6394-0d4c-49d9-b84d-f8bc89b08357 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.365129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1d38-bb54-4e0b-9b9b-421c12446100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.365813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1d38-bb54-4e0b-9b9b-421c12446100 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.366097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1d38-bb54-4e0b-9b9b-421c12446100 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.366366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1d38-bb54-4e0b-9b9b-421c12446100 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.367142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1d38-bb54-4e0b-9b9b-421c12446100 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:03.367732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1d38-bb54-4e0b-9b9b-421c12446100 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.371569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1d38-bb54-4e0b-9b9b-421c12446100 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.378837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 463/929] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/services?type=image => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:03.385227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.400608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18b921-cd17-4200-a4f3-350ceb8625c5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.406345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf96d76-8ffd-4f88-bf6e-8b9c39e59c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.407185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96d76-8ffd-4f88-bf6e-8b9c39e59c1c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.407570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96d76-8ffd-4f88-bf6e-8b9c39e59c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.407915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf96d76-8ffd-4f88-bf6e-8b9c39e59c1c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.408745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96d76-8ffd-4f88-bf6e-8b9c39e59c1c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.410473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf96d76-8ffd-4f88-bf6e-8b9c39e59c1c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.430581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 467/930] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:18:03 2021] POST /identity/v3/endpoints => generated 327 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:03.447819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a79b-4a0c-44a5-88e5-4c32997ca495 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.448202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a79b-4a0c-44a5-88e5-4c32997ca495 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.448572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a79b-4a0c-44a5-88e5-4c32997ca495 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.450899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 464/931] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:03.458198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b174-5087-4232-891e-31cf88a09eba None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.458774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b174-5087-4232-891e-31cf88a09eba None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.459250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b174-5087-4232-891e-31cf88a09eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.478964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-2b57b174-5087-4232-891e-31cf88a09eba None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:03.480584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2b57b174-5087-4232-891e-31cf88a09eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:03.503413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 468/932] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:03.526891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a79b-4a0c-44a5-88e5-4c32997ca495 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.540669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a79b-4a0c-44a5-88e5-4c32997ca495 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.545454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.546278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.546728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.547082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.560020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:03.567606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:18:03.568988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 465/933] 10.222.0.58 () {56 vars in 1142 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:03.575962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57b174-5087-4232-891e-31cf88a09eba None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.585980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57b174-5087-4232-891e-31cf88a09eba None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.590822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.591536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.591821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.592095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.592852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:03.593158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.595246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.604567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 469/934] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:03.611712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.622317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2eecf-8cf8-4d25-971f-f1c09e57f79f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.627943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.628730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.629001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.629265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.641053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.643019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.660891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:18:03.662356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 466/935] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:03.668912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.679739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe895-d4a1-4d42-a242-264b87ad39e3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.685894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.686635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.686991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.687331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.688161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:03.688553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.690247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.703169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 470/936] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:03.709651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.720030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda6e2-0aed-4536-ab12-e091a670da83 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.725371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.726153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.726449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.726722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.734366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.736740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.750535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:18:03.751898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 467/937] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:03.758326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.768170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466dbc9-5c1f-4858-aa09-9b945e129d22 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.772950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.773648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.773923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.774192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.775044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:03.775381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.777307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.796661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 471/938] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:03.802906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.813687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb18aa-d075-430f-b86f-73755f1b7dda admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.818587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.819231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.819542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.819818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.827924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.829816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.838937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 468/939] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:03.845458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.857355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff4873-47f4-423a-89c6-2f1e397b34fd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.862293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.863221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.863657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.864033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.875234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.877208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.895137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:18:03.896708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 472/940] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:03.902895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.912103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d4f6a-827a-479e-8fc2-0b82e6743dc9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.917046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.917696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.918039 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.918299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.919009 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:03.919322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.920941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.933305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 469/941] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:03.939500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.949700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2a3cc-daa0-4aba-ba1c-fff33a9f709d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:03.955000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:03.955925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:03.956311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:03.956676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:03.963925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:03.965963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:03.979337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:18:03.980823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 473/942] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:03.987164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:03.997182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8add-895e-4ad2-98d7-2cc9c4bef98c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:04.003205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cd2ea-8efd-4f18-9b81-8ccee748350b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:04.003981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd2ea-8efd-4f18-9b81-8ccee748350b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:04.004397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd2ea-8efd-4f18-9b81-8ccee748350b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:04.004727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cd2ea-8efd-4f18-9b81-8ccee748350b admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:04.005575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cd2ea-8efd-4f18-9b81-8ccee748350b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:04.005946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cd2ea-8efd-4f18-9b81-8ccee748350b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:04.007895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cd2ea-8efd-4f18-9b81-8ccee748350b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:04.020427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 470/943] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:18:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:04.026927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:04.037364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c729-9741-4ce9-9a04-7dc2eab9f59d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:04.042039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ecab-8071-48f3-bb0a-3415ba5e3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:04.042949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ecab-8071-48f3-bb0a-3415ba5e3a09 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:04.043321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ecab-8071-48f3-bb0a-3415ba5e3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:04.043749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ecab-8071-48f3-bb0a-3415ba5e3a09 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:04.044733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ecab-8071-48f3-bb0a-3415ba5e3a09 admin admin] RBAC: Adding query filter params (role.id=c1852650b3b54f34ab1f91b15bea4cd5, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=068da11e10ca4a788bb08a42206ca42e) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:04.045137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ecab-8071-48f3-bb0a-3415ba5e3a09 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:04.047102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ecab-8071-48f3-bb0a-3415ba5e3a09 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:04.053254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 474/944] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:04 2021] GET /identity/v3/role_assignments?user.id=068da11e10ca4a788bb08a42206ca42e&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=c1852650b3b54f34ab1f91b15bea4cd5 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:04.790823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23e6eb-15da-4bb3-b42d-edc8fa22ee5e None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:04.791402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23e6eb-15da-4bb3-b42d-edc8fa22ee5e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:04.791402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23e6eb-15da-4bb3-b42d-edc8fa22ee5e None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:04.793183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 471/945] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:04.799602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538480ed-360e-417c-b32f-f9702d24de9b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:04.800037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538480ed-360e-417c-b32f-f9702d24de9b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:04.800139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538480ed-360e-417c-b32f-f9702d24de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:04.818449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-538480ed-360e-417c-b32f-f9702d24de9b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:04.819682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-538480ed-360e-417c-b32f-f9702d24de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:04.828149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 475/946] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:04.854153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23e6eb-15da-4bb3-b42d-edc8fa22ee5e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:04.867734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23e6eb-15da-4bb3-b42d-edc8fa22ee5e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:04.872346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b612463-0ab6-4ac0-9539-bba6ade351c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:04.873141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b612463-0ab6-4ac0-9539-bba6ade351c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:04.873463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b612463-0ab6-4ac0-9539-bba6ade351c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:04.873740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b612463-0ab6-4ac0-9539-bba6ade351c6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:04.875738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b612463-0ab6-4ac0-9539-bba6ade351c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:04.877469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b612463-0ab6-4ac0-9539-bba6ade351c6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:04.879249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 472/947] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:04.885806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538480ed-360e-417c-b32f-f9702d24de9b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:04.895687 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538480ed-360e-417c-b32f-f9702d24de9b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:04.900769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca39caf-1195-4d77-8ff3-2cf88afb8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:04.901532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca39caf-1195-4d77-8ff3-2cf88afb8c0b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:04.901870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca39caf-1195-4d77-8ff3-2cf88afb8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:04.902201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca39caf-1195-4d77-8ff3-2cf88afb8c0b admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:04.902980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca39caf-1195-4d77-8ff3-2cf88afb8c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:04.904982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca39caf-1195-4d77-8ff3-2cf88afb8c0b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:04.935202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 476/948] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:18:04 2021] POST /identity/v3/users => generated 285 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:18:05.653462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc06e-f30b-41b0-a68e-d80c77525350 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:05.653650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc06e-f30b-41b0-a68e-d80c77525350 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:05.653933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dc06e-f30b-41b0-a68e-d80c77525350 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:05.655924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 473/949] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:05.662177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a43976-6e4f-4e81-bb7e-5f6ae2b3a263 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:05.662430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a43976-6e4f-4e81-bb7e-5f6ae2b3a263 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:05.662740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a43976-6e4f-4e81-bb7e-5f6ae2b3a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:05.683058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-26a43976-6e4f-4e81-bb7e-5f6ae2b3a263 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:05.684292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-26a43976-6e4f-4e81-bb7e-5f6ae2b3a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:05.692837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 477/950] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:05.716944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dc06e-f30b-41b0-a68e-d80c77525350 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:05.730242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dc06e-f30b-41b0-a68e-d80c77525350 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:05.735483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434960e8-895b-424b-93d9-8f8e1129ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:05.736132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434960e8-895b-424b-93d9-8f8e1129ebd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:05.736413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434960e8-895b-424b-93d9-8f8e1129ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:05.736686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434960e8-895b-424b-93d9-8f8e1129ebd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:05.744722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434960e8-895b-424b-93d9-8f8e1129ebd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:05.746530 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434960e8-895b-424b-93d9-8f8e1129ebd3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:05.756293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 474/951] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:05.762614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a43976-6e4f-4e81-bb7e-5f6ae2b3a263 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:05.771912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a43976-6e4f-4e81-bb7e-5f6ae2b3a263 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:05.776675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802d967-e6ca-46ec-927b-24fe8674499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:05.777560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802d967-e6ca-46ec-927b-24fe8674499d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:05.777914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802d967-e6ca-46ec-927b-24fe8674499d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:05.778250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802d967-e6ca-46ec-927b-24fe8674499d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:05.779538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802d967-e6ca-46ec-927b-24fe8674499d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:05.781303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802d967-e6ca-46ec-927b-24fe8674499d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:05.783151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 478/952] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:06.162054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03dc49-a8e9-4a67-85ef-19be53e603a3 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.162615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03dc49-a8e9-4a67-85ef-19be53e603a3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.162615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03dc49-a8e9-4a67-85ef-19be53e603a3 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.164548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 475/953] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:06.171030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f82c2-d815-4d06-a838-30bf50f55cf4 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.171600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f82c2-d815-4d06-a838-30bf50f55cf4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.171600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f82c2-d815-4d06-a838-30bf50f55cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.192139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-939f82c2-d815-4d06-a838-30bf50f55cf4 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:06.193351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-939f82c2-d815-4d06-a838-30bf50f55cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:06.202715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 479/954] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:06.226841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03dc49-a8e9-4a67-85ef-19be53e603a3 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.241103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03dc49-a8e9-4a67-85ef-19be53e603a3 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.246017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.246920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.247218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.247525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.260226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:06.267307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:18:06.268526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 476/955] 10.222.0.58 () {56 vars in 1142 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:06.275082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f82c2-d815-4d06-a838-30bf50f55cf4 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.284974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f82c2-d815-4d06-a838-30bf50f55cf4 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.289924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.290581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.290854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.291131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.291920 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:06.292223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.293807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.302309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 480/956] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:06.308982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.320297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf9c3f-b7bd-4d04-87fd-da6644ca7342 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.326162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.326937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.327214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.327522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.338795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.340670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.357854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:18:06.359014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 477/957] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:06.365450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.376202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653999-96f0-4fe3-9800-7699843bb8e8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.382142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.382805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.383090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.383386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.384125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:06.384431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.386026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.399168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 481/958] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:06.405767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.416498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40aa1-08df-4464-bc30-d8b92cf74ca9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.422788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.423688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.423994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.424269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.432036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.434408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.448394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:18:06.449586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 478/959] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:06.456482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.466278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2111d-124f-4851-bb6f-83e393eeda9a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.471364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.472045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.472325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.472600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.473443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:06.473749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.475635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.492933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 482/960] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:18:06.499108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.509043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93dc9-d7c4-457b-895b-c78953d361b7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.514017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.514795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.515074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.515549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.526150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.528043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.545025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:18:06.546223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 479/961] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:06.552772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.564491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd52f3-7478-48d6-9c19-e5f2ae69d7e4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.570509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.571284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.571602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.571875 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.572640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:06.572941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.574542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.586993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 483/962] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:06.593473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.603304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e90b-43c3-43c3-801e-81551ac9202f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.607902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.608686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.609135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.609424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.616330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.618289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.630822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:18:06.632018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 480/963] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:06.638578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.649002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069ea6f-8ba3-492f-82ee-fde2abeabdf0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.654483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e61a08-b37d-4109-a6fe-2ceb2a46f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.655144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61a08-b37d-4109-a6fe-2ceb2a46f7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.655455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61a08-b37d-4109-a6fe-2ceb2a46f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.655731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61a08-b37d-4109-a6fe-2ceb2a46f7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.656620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e61a08-b37d-4109-a6fe-2ceb2a46f7b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:06.656929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e61a08-b37d-4109-a6fe-2ceb2a46f7b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.658792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e61a08-b37d-4109-a6fe-2ceb2a46f7b0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.671750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 484/964] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:18:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:06.681921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:06.694189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9ec77-4bf1-48a7-b606-2d766a849c2f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:06.699981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b85af2-1807-4d47-85a7-ccf0d5e8629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:06.700863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85af2-1807-4d47-85a7-ccf0d5e8629a admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:06.701144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85af2-1807-4d47-85a7-ccf0d5e8629a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:06.701420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85af2-1807-4d47-85a7-ccf0d5e8629a admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/068da11e10ca4a788bb08a42206ca42e/roles/c1852650b3b54f34ab1f91b15bea4cd5` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:06.704138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b85af2-1807-4d47-85a7-ccf0d5e8629a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=068da11e10ca4a788bb08a42206ca42e, role_id=c1852650b3b54f34ab1f91b15bea4cd5)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:06.706783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b85af2-1807-4d47-85a7-ccf0d5e8629a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:06.721417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 481/965] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:18:06 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/068da11e10ca4a788bb08a42206ca42e/roles/c1852650b3b54f34ab1f91b15bea4cd5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:18:07.158293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195fd7-5c69-44c4-b311-57d63ac3cfcb None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.158951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195fd7-5c69-44c4-b311-57d63ac3cfcb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.158951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195fd7-5c69-44c4-b311-57d63ac3cfcb None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.160568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 485/966] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:07.166675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f460-23a8-4f38-afe3-e0d9ea3f7253 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.167174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f460-23a8-4f38-afe3-e0d9ea3f7253 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.167262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79f460-23a8-4f38-afe3-e0d9ea3f7253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.187683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3c79f460-23a8-4f38-afe3-e0d9ea3f7253 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:07.188811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3c79f460-23a8-4f38-afe3-e0d9ea3f7253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:07.249739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 482/967] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:07.274438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e195fd7-5c69-44c4-b311-57d63ac3cfcb None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:07.287959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e195fd7-5c69-44c4-b311-57d63ac3cfcb None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:07.292632 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:07.293485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.293768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.294056 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.305155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:07.312159 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:07.313331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 486/968] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:07.320398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f460-23a8-4f38-afe3-e0d9ea3f7253 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:07.329698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79f460-23a8-4f38-afe3-e0d9ea3f7253 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:07.335020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:07.335708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.335988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.336261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.337008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:07.337309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:07.338896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:07.347662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 483/969] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:07.354131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:07.364723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecf3b-5509-4d8e-b811-73bac79b4cd6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:07.369701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:07.370560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.370804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.371098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] PATH_INFO: `/v3/users/b3f5f7fb888b40f49938469848f70fd4` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.385094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] RBAC: Authorizing `identity:get_user(user_id=b3f5f7fb888b40f49938469848f70fd4)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:07.387208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:07.388943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 487/970] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:07 2021] GET /identity/v3/users/b3f5f7fb888b40f49938469848f70fd4 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:18:07.395846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:07.406113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c443b-af0e-4d76-9a0e-066d5c1bfcdd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:07.411912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:07.412503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.412779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.413044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.421313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:07.423283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:07.432380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 484/971] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:07 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:07.439246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:07.449622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7134e-4d66-44f0-ba4c-45477091335d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:07.455542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e943c-a1bd-48c2-a8b7-c2fe824dda50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:07.456378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e943c-a1bd-48c2-a8b7-c2fe824dda50 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.456647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e943c-a1bd-48c2-a8b7-c2fe824dda50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.456940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e943c-a1bd-48c2-a8b7-c2fe824dda50 admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.458230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e943c-a1bd-48c2-a8b7-c2fe824dda50 admin admin] RBAC: Authorizing `identity:get_project(project_id=29ce62da2562407c9e293fa3163cb912)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:07.460415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e943c-a1bd-48c2-a8b7-c2fe824dda50 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:07.462123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 488/972] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:07 2021] GET /identity/v3/projects/29ce62da2562407c9e293fa3163cb912 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:07.469228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:07.478732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20da72-5338-4174-92cb-958d0fe9ad22 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:07.484636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092629-0ddf-4b58-9007-0e7eb714af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:07.485214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092629-0ddf-4b58-9007-0e7eb714af30 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:07.485484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092629-0ddf-4b58-9007-0e7eb714af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:07.485727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092629-0ddf-4b58-9007-0e7eb714af30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:07.486633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b092629-0ddf-4b58-9007-0e7eb714af30 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=29ce62da2562407c9e293fa3163cb912, user.id=b3f5f7fb888b40f49938469848f70fd4) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:07.486970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b092629-0ddf-4b58-9007-0e7eb714af30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:07.488805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b092629-0ddf-4b58-9007-0e7eb714af30 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:07.494840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 485/973] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:07 2021] GET /identity/v3/role_assignments?user.id=b3f5f7fb888b40f49938469848f70fd4&scope.project.id=29ce62da2562407c9e293fa3163cb912&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:08.832041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621ec9-7eae-40c2-9b86-14ef2fc2c23a None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:08.832608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621ec9-7eae-40c2-9b86-14ef2fc2c23a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:08.832608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621ec9-7eae-40c2-9b86-14ef2fc2c23a None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:08.834560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 489/974] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:08.840293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5998-4085-4b02-8bb3-377f73414ad1 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:08.840745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5998-4085-4b02-8bb3-377f73414ad1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:08.840836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5998-4085-4b02-8bb3-377f73414ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:08.859054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-57ae5998-4085-4b02-8bb3-377f73414ad1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:08.860283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-57ae5998-4085-4b02-8bb3-377f73414ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:08.868438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 486/975] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:08.893042 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56621ec9-7eae-40c2-9b86-14ef2fc2c23a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:08.906067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56621ec9-7eae-40c2-9b86-14ef2fc2c23a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:08.910947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:08.911795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:08.912081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:08.912361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:08.923819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:08.931057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 03:18:08.932316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 490/976] 10.222.0.58 () {56 vars in 1142 bytes} [Fri Aug 27 03:18:08 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:08.939551 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5998-4085-4b02-8bb3-377f73414ad1 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:08.949095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5998-4085-4b02-8bb3-377f73414ad1 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:08.955174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:08.955866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:08.956146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:08.956415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:08.957147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:08.957446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:08.959077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:08.968042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 487/977] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Aug 27 03:18:08 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:08.974330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:08.985534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d04f80-b419-452a-bd84-b04e7524aaa8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:08.991474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:08.992254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:08.992536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:08.992804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.004119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.005956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.023631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:18:09.025058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 491/978] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:09.031386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.041814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e70c7-1dc3-41a0-aa31-be45db887ef6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.047830 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.048515 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.048795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.049043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.049754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:09.050056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.051682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.064737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 488/979] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:09.071119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.081892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fb040-ef5f-41a6-8cd7-d59794d9b707 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.088025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.088760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.089040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.089311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.097670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.099734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.114063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 03:18:09.115287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 492/980] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:09.121906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.133456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93225c-d2b8-400c-8663-41e39e077b76 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.138480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.139142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.139461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.139734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.140613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:09.141023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.142872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.160638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 489/981] 10.222.0.58 () {56 vars in 1155 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:09.167054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.177417 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c777d21-865f-4a98-ab36-fe9b3d226361 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.183581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.184234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.184513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.184779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.193464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.195240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.204717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 493/982] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:09.211255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.221818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320b4ab-f2a8-4be8-b420-9fc5465a7b48 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.227952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.228862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.229210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.229549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.241123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.242978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.260229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:18:09.261452 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 490/983] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:09.268539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.277909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157dd83-c1e7-4fce-b0fd-12aefe86acd3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.283971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.284625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.284905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.285176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.285900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:09.286206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.287801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.299927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 494/984] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:09.306450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.316890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f795ea-379d-4802-add8-5e97047b0883 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.322728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.323555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.323838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.324107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.331821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.333819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.346680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:18:09.347837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 491/985] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:18:09.354527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.364236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4eab8-4cf1-436b-8200-0621a646da86 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.368925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b221d-1e70-4b9e-8ad1-64d793d52ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.369514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b221d-1e70-4b9e-8ad1-64d793d52ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.369793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b221d-1e70-4b9e-8ad1-64d793d52ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.370061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b221d-1e70-4b9e-8ad1-64d793d52ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.370847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b221d-1e70-4b9e-8ad1-64d793d52ee2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:09.371149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b221d-1e70-4b9e-8ad1-64d793d52ee2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.372999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b221d-1e70-4b9e-8ad1-64d793d52ee2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.385401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 495/986] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:18:09.392276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.404708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d3a65-dee9-4037-9c1d-aebff21a6b17 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.409516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de10a13-fe26-491a-982c-7020e957254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.410161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10a13-fe26-491a-982c-7020e957254f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.410440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10a13-fe26-491a-982c-7020e957254f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.410691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de10a13-fe26-491a-982c-7020e957254f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.411547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de10a13-fe26-491a-982c-7020e957254f admin admin] RBAC: Adding query filter params (role.id=c1852650b3b54f34ab1f91b15bea4cd5, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=068da11e10ca4a788bb08a42206ca42e) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:09.411848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de10a13-fe26-491a-982c-7020e957254f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.413700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de10a13-fe26-491a-982c-7020e957254f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.419732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 492/987] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/role_assignments?user.id=068da11e10ca4a788bb08a42206ca42e&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=c1852650b3b54f34ab1f91b15bea4cd5 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:09.662901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753f9e-af04-48a9-90a2-747ba2e7d7ea None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.663190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753f9e-af04-48a9-90a2-747ba2e7d7ea None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.663501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753f9e-af04-48a9-90a2-747ba2e7d7ea None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.665280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 496/988] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:09.671474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129d75e-5759-4769-ab36-51c8a4a848e4 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.671981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129d75e-5759-4769-ab36-51c8a4a848e4 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.672288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129d75e-5759-4769-ab36-51c8a4a848e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.691138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0129d75e-5759-4769-ab36-51c8a4a848e4 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:09.692367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0129d75e-5759-4769-ab36-51c8a4a848e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:09.701126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 493/989] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:09.725237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753f9e-af04-48a9-90a2-747ba2e7d7ea None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.738396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753f9e-af04-48a9-90a2-747ba2e7d7ea None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.743034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.743857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.744137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.744404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.756849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:09.763680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:09.764883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 497/990] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:09.772138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129d75e-5759-4769-ab36-51c8a4a848e4 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.781524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129d75e-5759-4769-ab36-51c8a4a848e4 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.786409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.787087 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.787394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.787674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.788726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:09.788726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.790325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.800133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 494/991] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:09.806923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.818635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55151-e735-421a-836a-0ac93ba60d28 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.824322 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.825200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.825479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.825743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] PATH_INFO: `/v3/users/b3f5f7fb888b40f49938469848f70fd4` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.826947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] RBAC: Authorizing `identity:get_user(user_id=b3f5f7fb888b40f49938469848f70fd4)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.829163 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.830805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 498/992] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/users/b3f5f7fb888b40f49938469848f70fd4 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:09.837444 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.848642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328282bc-27c8-4450-8f84-5d80e0eec1d7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.853526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843de6ad-f6cd-4452-96e9-b4b9dfc6eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.854392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de6ad-f6cd-4452-96e9-b4b9dfc6eaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.854676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de6ad-f6cd-4452-96e9-b4b9dfc6eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.854950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de6ad-f6cd-4452-96e9-b4b9dfc6eaf4 admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.856179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843de6ad-f6cd-4452-96e9-b4b9dfc6eaf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=29ce62da2562407c9e293fa3163cb912)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.858237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843de6ad-f6cd-4452-96e9-b4b9dfc6eaf4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.861933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 495/993] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:09 2021] GET /identity/v3/projects/29ce62da2562407c9e293fa3163cb912 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:09.869015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:09.879295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8064506-cefc-407f-9cfd-f6dbef471087 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:09.884005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327c95-e8e6-469a-8ac2-37de66d42743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:09.884892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327c95-e8e6-469a-8ac2-37de66d42743 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:09.885171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327c95-e8e6-469a-8ac2-37de66d42743 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:09.885441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327c95-e8e6-469a-8ac2-37de66d42743 admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912/users/b3f5f7fb888b40f49938469848f70fd4/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:09.887810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327c95-e8e6-469a-8ac2-37de66d42743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ce62da2562407c9e293fa3163cb912, user_id=b3f5f7fb888b40f49938469848f70fd4, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:09.890450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327c95-e8e6-469a-8ac2-37de66d42743 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:09.907274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 499/994] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:18:09 2021] PUT /identity/v3/projects/29ce62da2562407c9e293fa3163cb912/users/b3f5f7fb888b40f49938469848f70fd4/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:18:12.003331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fdf7-7c47-412c-8bf6-0663d9646fc8 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.003927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fdf7-7c47-412c-8bf6-0663d9646fc8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.003927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700fdf7-7c47-412c-8bf6-0663d9646fc8 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.005680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 496/995] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:12.015763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36707b3-5f71-449a-90d7-e885a7510972 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.016617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36707b3-5f71-449a-90d7-e885a7510972 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.016617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36707b3-5f71-449a-90d7-e885a7510972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.041312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d36707b3-5f71-449a-90d7-e885a7510972 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:12.042510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d36707b3-5f71-449a-90d7-e885a7510972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:12.103787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 500/996] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:12.129354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700fdf7-7c47-412c-8bf6-0663d9646fc8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:12.151240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700fdf7-7c47-412c-8bf6-0663d9646fc8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:12.161035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:12.162165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.162547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.162888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.181123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:12.190550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:12.191782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 497/997] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:12.198545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36707b3-5f71-449a-90d7-e885a7510972 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:12.207870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36707b3-5f71-449a-90d7-e885a7510972 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:12.213458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:12.214118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.214401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.214672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.215470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:12.215776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:12.217371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:12.225871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 501/998] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:12.232305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:12.243698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1290fb0-ff3d-417e-aed5-2e152b673666 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:12.249533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:12.250508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.250784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.251066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] PATH_INFO: `/v3/users/b3f5f7fb888b40f49938469848f70fd4` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.252521 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] RBAC: Authorizing `identity:get_user(user_id=b3f5f7fb888b40f49938469848f70fd4)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:12.254728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:12.256289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 498/999] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:12 2021] GET /identity/v3/users/b3f5f7fb888b40f49938469848f70fd4 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:18:12.262664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:12.273708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b838ac-84fd-435e-afe2-eb10eeadd4df admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:12.280337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:12.280999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.281282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.281558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.290388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:12.292158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:12.301813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 502/1000] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:12.309096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:12.320316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241651-ad35-41b5-b222-73177a064a09 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:12.326027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153e77e-d912-42ca-87e0-bc130918a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:12.326862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e77e-d912-42ca-87e0-bc130918a874 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.327207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e77e-d912-42ca-87e0-bc130918a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.327931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e77e-d912-42ca-87e0-bc130918a874 admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.329223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153e77e-d912-42ca-87e0-bc130918a874 admin admin] RBAC: Authorizing `identity:get_project(project_id=29ce62da2562407c9e293fa3163cb912)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:12.331455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153e77e-d912-42ca-87e0-bc130918a874 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:12.333122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 499/1001] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:12 2021] GET /identity/v3/projects/29ce62da2562407c9e293fa3163cb912 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:12.339903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:12.349663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938c8a4-641d-4375-9d64-02c02e7752ea admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:12.355611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede600e-73e4-46c8-a91a-74618e4bccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:12.356245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede600e-73e4-46c8-a91a-74618e4bccd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:12.356529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede600e-73e4-46c8-a91a-74618e4bccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:12.356802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede600e-73e4-46c8-a91a-74618e4bccd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:12.357628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede600e-73e4-46c8-a91a-74618e4bccd2 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=29ce62da2562407c9e293fa3163cb912, user.id=b3f5f7fb888b40f49938469848f70fd4) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:12.357940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede600e-73e4-46c8-a91a-74618e4bccd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:12.360240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede600e-73e4-46c8-a91a-74618e4bccd2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:12.366909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 503/1002] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:12 2021] GET /identity/v3/role_assignments?user.id=b3f5f7fb888b40f49938469848f70fd4&scope.project.id=29ce62da2562407c9e293fa3163cb912&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:14.523855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a91b-d0a8-452d-8a2a-ae4b3a84e266 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:14.524766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a91b-d0a8-452d-8a2a-ae4b3a84e266 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:14.524766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a91b-d0a8-452d-8a2a-ae4b3a84e266 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:14.527707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 500/1003] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:14.534049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108d42-b1d2-45fa-89d0-40e07e6cb1ed None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:14.534472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108d42-b1d2-45fa-89d0-40e07e6cb1ed None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:14.534581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108d42-b1d2-45fa-89d0-40e07e6cb1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:14.554332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-cb108d42-b1d2-45fa-89d0-40e07e6cb1ed None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:14.555561 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-cb108d42-b1d2-45fa-89d0-40e07e6cb1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:14.564956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 504/1004] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:14.590573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a91b-d0a8-452d-8a2a-ae4b3a84e266 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:14.606453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a91b-d0a8-452d-8a2a-ae4b3a84e266 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:14.612842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55625-19ba-428b-b584-fe45eac33308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:14.613621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55625-19ba-428b-b584-fe45eac33308 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:14.613902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55625-19ba-428b-b584-fe45eac33308 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:14.614170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55625-19ba-428b-b584-fe45eac33308 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:14.615512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55625-19ba-428b-b584-fe45eac33308 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:14.617194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55625-19ba-428b-b584-fe45eac33308 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:14.618758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 501/1005] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:14.627414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108d42-b1d2-45fa-89d0-40e07e6cb1ed None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:14.637954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108d42-b1d2-45fa-89d0-40e07e6cb1ed None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:14.644375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f292e-ef43-44fa-b572-c22cc98c12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:14.645087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f292e-ef43-44fa-b572-c22cc98c12a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:14.645308 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f292e-ef43-44fa-b572-c22cc98c12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:14.645574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f292e-ef43-44fa-b572-c22cc98c12a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:14.646296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f292e-ef43-44fa-b572-c22cc98c12a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:14.648232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f292e-ef43-44fa-b572-c22cc98c12a8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:14.672296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 505/1006] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:18:14 2021] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:16.863005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24e31f-a1c2-4202-ab16-adef9b639083 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:16.863666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24e31f-a1c2-4202-ab16-adef9b639083 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:16.863666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24e31f-a1c2-4202-ab16-adef9b639083 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:16.865374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 502/1007] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:16.872603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881cea2-0259-4ca3-b36b-d83de750a140 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:16.873301 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881cea2-0259-4ca3-b36b-d83de750a140 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:16.873493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881cea2-0259-4ca3-b36b-d83de750a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:16.893018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a881cea2-0259-4ca3-b36b-d83de750a140 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:16.894227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a881cea2-0259-4ca3-b36b-d83de750a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:16.904522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 506/1008] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:16.928818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24e31f-a1c2-4202-ab16-adef9b639083 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:16.943301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24e31f-a1c2-4202-ab16-adef9b639083 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:16.948804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:16.949637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:16.949915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:16.950181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] PATH_INFO: `/v3/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:16.951756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] RBAC: Authorizing `identity:get_role(role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:16.952940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:18:16.952940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:18:16.952940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:18:16.953802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:16.955109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 503/1009] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:16 2021] GET /identity/v3/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:16.964901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881cea2-0259-4ca3-b36b-d83de750a140 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:16.979723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881cea2-0259-4ca3-b36b-d83de750a140 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:16.987760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:16.988593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:16.988869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:16.989140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] PATH_INFO: `/v3/users/61851fbcb8f94386a744419feeeb37d0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:17.003240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] RBAC: Authorizing `identity:get_user(user_id=61851fbcb8f94386a744419feeeb37d0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:17.005401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:17.007056 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 507/1010] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:16 2021] GET /identity/v3/users/61851fbcb8f94386a744419feeeb37d0 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:17.016602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:17.026753 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8e79d-44a6-4290-9cb2-df60709a9168 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:17.032262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:17.032900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:17.033182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:17.033456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:17.041805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:17.043590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:17.053113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 504/1011] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:17.060452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:17.076866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7a26d-9b8a-43bc-91c0-8d3af1847608 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:17.083868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b26b82-5fcc-4d77-9005-5c2b97d3692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:17.084709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26b82-5fcc-4d77-9005-5c2b97d3692e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:17.084989 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26b82-5fcc-4d77-9005-5c2b97d3692e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:17.085259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26b82-5fcc-4d77-9005-5c2b97d3692e admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:17.086637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b26b82-5fcc-4d77-9005-5c2b97d3692e admin admin] RBAC: Authorizing `identity:get_project(project_id=29ce62da2562407c9e293fa3163cb912)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:17.088684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b26b82-5fcc-4d77-9005-5c2b97d3692e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:17.090306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 508/1012] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:17 2021] GET /identity/v3/projects/29ce62da2562407c9e293fa3163cb912 => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:18:17.100589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:17.113292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa12a3-0ffe-4be7-add7-8b48d2de0486 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:17.119661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42da887-5cb7-4078-80a6-99e2f19e2c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:17.120287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da887-5cb7-4078-80a6-99e2f19e2c61 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:17.120561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da887-5cb7-4078-80a6-99e2f19e2c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:17.120825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da887-5cb7-4078-80a6-99e2f19e2c61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:17.121647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42da887-5cb7-4078-80a6-99e2f19e2c61 admin admin] RBAC: Adding query filter params (role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=29ce62da2562407c9e293fa3163cb912, user.id=61851fbcb8f94386a744419feeeb37d0) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:17.121951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42da887-5cb7-4078-80a6-99e2f19e2c61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:17.123817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42da887-5cb7-4078-80a6-99e2f19e2c61 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:17.129945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 505/1013] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:17 2021] GET /identity/v3/role_assignments?user.id=61851fbcb8f94386a744419feeeb37d0&scope.project.id=29ce62da2562407c9e293fa3163cb912&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:19.235114 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61d56-587e-4a81-89dc-39d719a4d822 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:19.236079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61d56-587e-4a81-89dc-39d719a4d822 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:19.236079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61d56-587e-4a81-89dc-39d719a4d822 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:19.238816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 509/1014] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:19.248839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ecb51-15de-4d72-8afa-752b4968cbb1 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:19.249634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ecb51-15de-4d72-8afa-752b4968cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:19.249803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ecb51-15de-4d72-8afa-752b4968cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:19.275237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-441ecb51-15de-4d72-8afa-752b4968cbb1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:19.276467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-441ecb51-15de-4d72-8afa-752b4968cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:19.286469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 506/1015] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:19.314829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61d56-587e-4a81-89dc-39d719a4d822 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:19.333024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61d56-587e-4a81-89dc-39d719a4d822 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:19.339091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:19.339982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:19.340261 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:19.340538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] PATH_INFO: `/v3/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:19.342240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] RBAC: Authorizing `identity:get_role(role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:19.343797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:18:19.343797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:18:19.343797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:18:19.344682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:19.345994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 510/1016] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:19 2021] GET /identity/v3/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 223 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:19.352996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ecb51-15de-4d72-8afa-752b4968cbb1 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:19.365178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ecb51-15de-4d72-8afa-752b4968cbb1 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:19.370585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:19.371486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:19.371769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:19.372042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] PATH_INFO: `/v3/users/61851fbcb8f94386a744419feeeb37d0` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:19.373358 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=61851fbcb8f94386a744419feeeb37d0)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:19.375861 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:19.377480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 507/1017] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:19 2021] GET /identity/v3/users/61851fbcb8f94386a744419feeeb37d0 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:19.384043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:19.395226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5415df1-d416-4e73-a329-0626d7138ebf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:19.400165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8f699-4e6c-4bc8-aaec-1cabc62001d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:19.401006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8f699-4e6c-4bc8-aaec-1cabc62001d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:19.401284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8f699-4e6c-4bc8-aaec-1cabc62001d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:19.401563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8f699-4e6c-4bc8-aaec-1cabc62001d8 admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:19.402787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8f699-4e6c-4bc8-aaec-1cabc62001d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=29ce62da2562407c9e293fa3163cb912)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:19.404865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8f699-4e6c-4bc8-aaec-1cabc62001d8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:19.407024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 511/1018] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:19 2021] GET /identity/v3/projects/29ce62da2562407c9e293fa3163cb912 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:19.413697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:19.424303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ef4c-b612-4c3a-8959-fa1fa8ab33d2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:19.429755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451de7f7-d683-4bd8-b353-acf2f8b8d53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:19.430633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451de7f7-d683-4bd8-b353-acf2f8b8d53c admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:19.430914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451de7f7-d683-4bd8-b353-acf2f8b8d53c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:19.431187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451de7f7-d683-4bd8-b353-acf2f8b8d53c admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912/users/61851fbcb8f94386a744419feeeb37d0/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:19.434177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451de7f7-d683-4bd8-b353-acf2f8b8d53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ce62da2562407c9e293fa3163cb912, user_id=61851fbcb8f94386a744419feeeb37d0, role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:19.437194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451de7f7-d683-4bd8-b353-acf2f8b8d53c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:19.454044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 508/1019] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:18:19 2021] PUT /identity/v3/projects/29ce62da2562407c9e293fa3163cb912/users/61851fbcb8f94386a744419feeeb37d0/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:18:21.637985 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af165d-1fe4-4890-9245-3900c7fc662a None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:21.638828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af165d-1fe4-4890-9245-3900c7fc662a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:21.638828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af165d-1fe4-4890-9245-3900c7fc662a None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:21.641671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 512/1020] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:21.648018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813fe8-f3bc-412c-99c8-71d588eea862 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:21.648419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813fe8-f3bc-412c-99c8-71d588eea862 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:21.648513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813fe8-f3bc-412c-99c8-71d588eea862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:21.668749 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b8813fe8-f3bc-412c-99c8-71d588eea862 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:21.669936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b8813fe8-f3bc-412c-99c8-71d588eea862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:21.740127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 509/1021] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:21.769670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af165d-1fe4-4890-9245-3900c7fc662a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:21.785962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af165d-1fe4-4890-9245-3900c7fc662a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:21.792964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:21.793820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:21.794302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:21.794800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] PATH_INFO: `/v3/roles/cd521a52b9ab46dda73fcc14818eb951` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:21.797377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] RBAC: Authorizing `identity:get_role(role_id=cd521a52b9ab46dda73fcc14818eb951)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:21.798995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:21.800453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 513/1022] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:21 2021] GET /identity/v3/roles/cd521a52b9ab46dda73fcc14818eb951 => generated 223 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:21.807298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813fe8-f3bc-412c-99c8-71d588eea862 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:21.818784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813fe8-f3bc-412c-99c8-71d588eea862 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:21.823936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:21.824801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:21.825079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:21.825354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] PATH_INFO: `/v3/users/61851fbcb8f94386a744419feeeb37d0` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:21.826577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] RBAC: Authorizing `identity:get_user(user_id=61851fbcb8f94386a744419feeeb37d0)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:21.829201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:21.830791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 510/1023] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:21 2021] GET /identity/v3/users/61851fbcb8f94386a744419feeeb37d0 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:21.837433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:21.848531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1d059-4778-438b-8e99-203f09c37e94 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:21.854438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:21.855066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:21.855378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:21.855654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:21.864543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:21.866272 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:21.876316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 514/1024] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:21.883237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:21.899671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650349-bfdf-4044-ac95-75658e4a497c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:21.908140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c083-0519-4c27-94e9-1b039309316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:21.908992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c083-0519-4c27-94e9-1b039309316a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:21.909271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c083-0519-4c27-94e9-1b039309316a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:21.909543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c083-0519-4c27-94e9-1b039309316a admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:21.910926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c083-0519-4c27-94e9-1b039309316a admin admin] RBAC: Authorizing `identity:get_project(project_id=29ce62da2562407c9e293fa3163cb912)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:21.913019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c083-0519-4c27-94e9-1b039309316a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:21.914687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 511/1025] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:21 2021] GET /identity/v3/projects/29ce62da2562407c9e293fa3163cb912 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:21.922487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:21.940711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7949-b2ca-4a2a-b02f-41ef6ad7c2d0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:21.946838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e268aa-ffd2-4b3b-ad9e-538920e5e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:21.947513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e268aa-ffd2-4b3b-ad9e-538920e5e626 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:21.947795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e268aa-ffd2-4b3b-ad9e-538920e5e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:21.948070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e268aa-ffd2-4b3b-ad9e-538920e5e626 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:21.948901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e268aa-ffd2-4b3b-ad9e-538920e5e626 admin admin] RBAC: Adding query filter params (role.id=cd521a52b9ab46dda73fcc14818eb951, scope.project.id=29ce62da2562407c9e293fa3163cb912, user.id=61851fbcb8f94386a744419feeeb37d0) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:21.949214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e268aa-ffd2-4b3b-ad9e-538920e5e626 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:21.951045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e268aa-ffd2-4b3b-ad9e-538920e5e626 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:21.957869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 515/1026] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:21 2021] GET /identity/v3/role_assignments?user.id=61851fbcb8f94386a744419feeeb37d0&scope.project.id=29ce62da2562407c9e293fa3163cb912&role.id=cd521a52b9ab46dda73fcc14818eb951 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:24.110560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5d50-3689-4ca6-8d45-689fe2643dc6 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:24.111166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5d50-3689-4ca6-8d45-689fe2643dc6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:24.111166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5d50-3689-4ca6-8d45-689fe2643dc6 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:24.112918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 512/1027] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:18:24.120018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1232767-d9cb-4296-a8b3-a5095ce5e3a7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:24.120717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1232767-d9cb-4296-a8b3-a5095ce5e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:24.120900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1232767-d9cb-4296-a8b3-a5095ce5e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:24.142304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f1232767-d9cb-4296-a8b3-a5095ce5e3a7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:24.143528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f1232767-d9cb-4296-a8b3-a5095ce5e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:24.153918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 516/1028] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:24.190421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d5d50-3689-4ca6-8d45-689fe2643dc6 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:24.204782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d5d50-3689-4ca6-8d45-689fe2643dc6 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:24.210347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d059b01-6575-4bea-b55f-d4a743ea60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:24.211105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d059b01-6575-4bea-b55f-d4a743ea60b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:24.211381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d059b01-6575-4bea-b55f-d4a743ea60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:24.211659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d059b01-6575-4bea-b55f-d4a743ea60b4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:24.212951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d059b01-6575-4bea-b55f-d4a743ea60b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:24.214623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d059b01-6575-4bea-b55f-d4a743ea60b4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:24.216205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 513/1029] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:24.223059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1232767-d9cb-4296-a8b3-a5095ce5e3a7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:24.238135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1232767-d9cb-4296-a8b3-a5095ce5e3a7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:24.247558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba922c7-5f64-4d97-9b9e-33b90dd4e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:24.248581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba922c7-5f64-4d97-9b9e-33b90dd4e4fb admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:24.249024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba922c7-5f64-4d97-9b9e-33b90dd4e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:24.249861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba922c7-5f64-4d97-9b9e-33b90dd4e4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:24.250574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba922c7-5f64-4d97-9b9e-33b90dd4e4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:24.252518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba922c7-5f64-4d97-9b9e-33b90dd4e4fb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:24.284501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 517/1030] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:18:24 2021] POST /identity/v3/projects => generated 311 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:26.434296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b0e-5c78-4004-82f4-ae89984a8094 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:26.435062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b0e-5c78-4004-82f4-ae89984a8094 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:26.435178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a8b0e-5c78-4004-82f4-ae89984a8094 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:26.437625 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 514/1031] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:26.444924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b166af-0823-4632-9d6a-a26f7a01f776 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:26.445365 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b166af-0823-4632-9d6a-a26f7a01f776 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:26.445480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b166af-0823-4632-9d6a-a26f7a01f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:26.472690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-54b166af-0823-4632-9d6a-a26f7a01f776 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:26.473921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-54b166af-0823-4632-9d6a-a26f7a01f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:26.533629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 518/1032] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:26.570844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8b0e-5c78-4004-82f4-ae89984a8094 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:26.597335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a8b0e-5c78-4004-82f4-ae89984a8094 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:26.602746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a6610-bff8-4bdb-a162-1460b9f64f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:26.603573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6610-bff8-4bdb-a162-1460b9f64f20 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:26.603854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6610-bff8-4bdb-a162-1460b9f64f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:26.604118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6610-bff8-4bdb-a162-1460b9f64f20 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:26.605507 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a6610-bff8-4bdb-a162-1460b9f64f20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:26.607209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a6610-bff8-4bdb-a162-1460b9f64f20 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:26.608934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 515/1033] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:18:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:26.616384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b166af-0823-4632-9d6a-a26f7a01f776 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:26.627463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b166af-0823-4632-9d6a-a26f7a01f776 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:26.632959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f53af-ab6a-4d6f-be3a-9e14c7abafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:26.633661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f53af-ab6a-4d6f-be3a-9e14c7abafca admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:26.633949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f53af-ab6a-4d6f-be3a-9e14c7abafca admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:26.634226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f53af-ab6a-4d6f-be3a-9e14c7abafca admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:26.634936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f53af-ab6a-4d6f-be3a-9e14c7abafca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:26.636889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f53af-ab6a-4d6f-be3a-9e14c7abafca admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:26.666246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 519/1034] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:18:26 2021] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:28.838465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09fba3-a098-49a3-a3e5-574e76bddc60 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:28.839484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09fba3-a098-49a3-a3e5-574e76bddc60 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:28.839484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09fba3-a098-49a3-a3e5-574e76bddc60 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:28.842336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 516/1035] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:28.849416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720274a5-a715-444c-9141-cff99fdf99a7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:28.849889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720274a5-a715-444c-9141-cff99fdf99a7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:28.850002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720274a5-a715-444c-9141-cff99fdf99a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:28.877993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-720274a5-a715-444c-9141-cff99fdf99a7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:28.879195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-720274a5-a715-444c-9141-cff99fdf99a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:28.886812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 520/1036] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:28.912266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09fba3-a098-49a3-a3e5-574e76bddc60 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:28.929911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09fba3-a098-49a3-a3e5-574e76bddc60 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:28.936051 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:28.936834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:28.937109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:28.937382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:28.949339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:28.956288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:28.957435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 517/1037] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:28.967614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720274a5-a715-444c-9141-cff99fdf99a7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:28.982471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720274a5-a715-444c-9141-cff99fdf99a7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:28.988954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:28.989608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:28.989888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:28.990151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:28.990897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:28.991199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:28.992849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:29.001692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 521/1038] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:29.008032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:29.020340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd07d7-eb5b-4848-b3cb-2426a2456c57 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:29.026203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:29.027049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:29.027322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:29.027627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] PATH_INFO: `/v3/users/33ae0fd9ad8a485b8e72fc99844c982c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:29.043727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=33ae0fd9ad8a485b8e72fc99844c982c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:29.045950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:29.047630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 518/1039] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:29 2021] GET /identity/v3/users/33ae0fd9ad8a485b8e72fc99844c982c => generated 286 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:29.058216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:29.074204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ff9e4-991e-4969-b5fd-101c73559a3c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:29.081257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:29.081885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:29.082163 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:29.082434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:29.090295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:29.092006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:29.101450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 522/1040] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:29.108733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:29.126483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea337fa8-9b69-4ea0-b85e-8f64397244c7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:29.136259 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a084d2-4e2b-4724-8f95-ad983c334928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:29.137613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a084d2-4e2b-4724-8f95-ad983c334928 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:29.138083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a084d2-4e2b-4724-8f95-ad983c334928 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:29.138537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a084d2-4e2b-4724-8f95-ad983c334928 admin admin] PATH_INFO: `/v3/projects/e8d002cb0098425b8f076a4ca5c2290f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:29.140428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a084d2-4e2b-4724-8f95-ad983c334928 admin admin] RBAC: Authorizing `identity:get_project(project_id=e8d002cb0098425b8f076a4ca5c2290f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:29.142476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a084d2-4e2b-4724-8f95-ad983c334928 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:29.144165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 519/1041] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:29 2021] GET /identity/v3/projects/e8d002cb0098425b8f076a4ca5c2290f => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:29.153901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:29.167265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c441b-ac12-4fd6-9078-4fc3b1df7b14 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:29.174130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c158017-56d3-434d-9883-c141c6391472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:29.174755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158017-56d3-434d-9883-c141c6391472 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:29.175033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158017-56d3-434d-9883-c141c6391472 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:29.175304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158017-56d3-434d-9883-c141c6391472 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:29.176148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158017-56d3-434d-9883-c141c6391472 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=e8d002cb0098425b8f076a4ca5c2290f, user.id=33ae0fd9ad8a485b8e72fc99844c982c) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:29.176455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158017-56d3-434d-9883-c141c6391472 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:29.178245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158017-56d3-434d-9883-c141c6391472 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:29.183993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 523/1042] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:29 2021] GET /identity/v3/role_assignments?user.id=33ae0fd9ad8a485b8e72fc99844c982c&scope.project.id=e8d002cb0098425b8f076a4ca5c2290f&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:31.337222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8921-e8eb-4fdc-a2a9-a657fdb75304 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:31.337845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8921-e8eb-4fdc-a2a9-a657fdb75304 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:31.337845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a8921-e8eb-4fdc-a2a9-a657fdb75304 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:31.340559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 520/1043] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:31.350430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078025b-8a38-4e61-ba5a-babe8ddd9d3f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:31.350856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078025b-8a38-4e61-ba5a-babe8ddd9d3f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:31.350990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078025b-8a38-4e61-ba5a-babe8ddd9d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:31.374538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0078025b-8a38-4e61-ba5a-babe8ddd9d3f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:31.375771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0078025b-8a38-4e61-ba5a-babe8ddd9d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:31.386342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 524/1044] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:31.423480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8921-e8eb-4fdc-a2a9-a657fdb75304 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:31.438408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a8921-e8eb-4fdc-a2a9-a657fdb75304 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:31.443381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:31.444175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:31.444450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:31.444721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:31.456191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:31.462752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:31.463910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 521/1045] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:31.471212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078025b-8a38-4e61-ba5a-babe8ddd9d3f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:31.481242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078025b-8a38-4e61-ba5a-babe8ddd9d3f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:31.488152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:31.488813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:31.489092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:31.489368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:31.490113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:31.490527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:31.492182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:31.502096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 525/1046] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:31.511891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:31.527800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793ba72-1c53-4aa1-8fc9-4375fb2c4f85 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:31.534255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:31.535096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:31.535383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:31.535664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] PATH_INFO: `/v3/users/33ae0fd9ad8a485b8e72fc99844c982c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:31.536966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=33ae0fd9ad8a485b8e72fc99844c982c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:31.539056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:31.540656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 522/1047] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:31 2021] GET /identity/v3/users/33ae0fd9ad8a485b8e72fc99844c982c => generated 286 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:31.547752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:31.563212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298f04c-a2e2-4357-9c46-8b6779e98cf4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:31.569378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1f6e2-7c5a-4c7e-aa60-af44b0490e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:31.570184 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1f6e2-7c5a-4c7e-aa60-af44b0490e3b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:31.570462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1f6e2-7c5a-4c7e-aa60-af44b0490e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:31.570732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1f6e2-7c5a-4c7e-aa60-af44b0490e3b admin admin] PATH_INFO: `/v3/projects/e8d002cb0098425b8f076a4ca5c2290f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:31.572112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1f6e2-7c5a-4c7e-aa60-af44b0490e3b admin admin] RBAC: Authorizing `identity:get_project(project_id=e8d002cb0098425b8f076a4ca5c2290f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:31.574371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1f6e2-7c5a-4c7e-aa60-af44b0490e3b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:31.576220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 526/1048] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:31 2021] GET /identity/v3/projects/e8d002cb0098425b8f076a4ca5c2290f => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:31.583013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:31.593408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a3c93-efa4-41a9-bea4-004495fc35a3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:31.599716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97c621-78f4-4555-8208-759f5e9092b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:31.600584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c621-78f4-4555-8208-759f5e9092b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:31.600862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c621-78f4-4555-8208-759f5e9092b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:31.601135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c621-78f4-4555-8208-759f5e9092b8 admin admin] PATH_INFO: `/v3/projects/e8d002cb0098425b8f076a4ca5c2290f/users/33ae0fd9ad8a485b8e72fc99844c982c/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:31.603566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c621-78f4-4555-8208-759f5e9092b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d002cb0098425b8f076a4ca5c2290f, user_id=33ae0fd9ad8a485b8e72fc99844c982c, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:31.606174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97c621-78f4-4555-8208-759f5e9092b8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:31.627530 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 523/1049] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:18:31 2021] PUT /identity/v3/projects/e8d002cb0098425b8f076a4ca5c2290f/users/33ae0fd9ad8a485b8e72fc99844c982c/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:18:33.745678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166de4a-6380-416b-8e39-ad445fdc60d1 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:33.746578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166de4a-6380-416b-8e39-ad445fdc60d1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:33.746578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166de4a-6380-416b-8e39-ad445fdc60d1 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:33.749634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 527/1050] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:33.760094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f233c5a-1dbb-4db8-9326-a25196e1d6f3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:33.760717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f233c5a-1dbb-4db8-9326-a25196e1d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:33.760868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f233c5a-1dbb-4db8-9326-a25196e1d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:33.787037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-6f233c5a-1dbb-4db8-9326-a25196e1d6f3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:33.788254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6f233c5a-1dbb-4db8-9326-a25196e1d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:33.847667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 524/1051] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:33.872502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166de4a-6380-416b-8e39-ad445fdc60d1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:33.885753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166de4a-6380-416b-8e39-ad445fdc60d1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:33.891060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:33.891893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:33.892176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:33.892447 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:33.902748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:33.909515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:33.910658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 528/1052] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:33.917407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f233c5a-1dbb-4db8-9326-a25196e1d6f3 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:33.927899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f233c5a-1dbb-4db8-9326-a25196e1d6f3 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:33.932838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:33.933490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:33.933769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:33.934038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:33.934787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:33.935094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:33.936850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:33.945255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 525/1053] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:33.951592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:33.962473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d71c-d09b-47d1-a8cb-b37b1a451afc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:33.966912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:33.967905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:33.968178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:33.968451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] PATH_INFO: `/v3/users/33ae0fd9ad8a485b8e72fc99844c982c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:33.969670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] RBAC: Authorizing `identity:get_user(user_id=33ae0fd9ad8a485b8e72fc99844c982c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:33.971799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:33.973435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 529/1054] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:33 2021] GET /identity/v3/users/33ae0fd9ad8a485b8e72fc99844c982c => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:33.983415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:34.000236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2583-f5f7-4ba3-a400-0c378ea6ab1f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:34.005964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:34.006639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:34.006922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:34.007184 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:34.015729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:34.017479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:34.026549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 526/1055] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:33 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:34.034096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:34.049535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d9606-fe2a-4583-9638-3d10dd43d79a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:34.059329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6c6e-f8d7-4646-85ec-b7f4b4262ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:34.060730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6c6e-f8d7-4646-85ec-b7f4b4262ffe admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:34.061163 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6c6e-f8d7-4646-85ec-b7f4b4262ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:34.061509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6c6e-f8d7-4646-85ec-b7f4b4262ffe admin admin] PATH_INFO: `/v3/projects/e8d002cb0098425b8f076a4ca5c2290f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:34.062922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6c6e-f8d7-4646-85ec-b7f4b4262ffe admin admin] RBAC: Authorizing `identity:get_project(project_id=e8d002cb0098425b8f076a4ca5c2290f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:34.065006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6c6e-f8d7-4646-85ec-b7f4b4262ffe admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:34.066680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 530/1056] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:34 2021] GET /identity/v3/projects/e8d002cb0098425b8f076a4ca5c2290f => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:34.077523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:34.092178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d79f-be76-4a8d-adbf-833237e153f7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:34.098446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5527ee2-b736-4977-83f9-45517881714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:34.099076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5527ee2-b736-4977-83f9-45517881714c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:34.099379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5527ee2-b736-4977-83f9-45517881714c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:34.099662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5527ee2-b736-4977-83f9-45517881714c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:34.100487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5527ee2-b736-4977-83f9-45517881714c admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=e8d002cb0098425b8f076a4ca5c2290f, user.id=33ae0fd9ad8a485b8e72fc99844c982c) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:34.100800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5527ee2-b736-4977-83f9-45517881714c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:34.102619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5527ee2-b736-4977-83f9-45517881714c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:34.108831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 527/1057] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:34 2021] GET /identity/v3/role_assignments?user.id=33ae0fd9ad8a485b8e72fc99844c982c&scope.project.id=e8d002cb0098425b8f076a4ca5c2290f&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:36.229908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334b285-d6bd-44a4-ae2b-5c064df1c8c8 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:36.230815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334b285-d6bd-44a4-ae2b-5c064df1c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:36.230815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334b285-d6bd-44a4-ae2b-5c064df1c8c8 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:36.233857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 531/1058] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:36.242965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f352-0f1e-4ee4-83df-9f6e89ccd2bd None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:36.243466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f352-0f1e-4ee4-83df-9f6e89ccd2bd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:36.243571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f352-0f1e-4ee4-83df-9f6e89ccd2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:36.263019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2c22f352-0f1e-4ee4-83df-9f6e89ccd2bd None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:36.264314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2c22f352-0f1e-4ee4-83df-9f6e89ccd2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:36.272969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 528/1059] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:18:36.296728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334b285-d6bd-44a4-ae2b-5c064df1c8c8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:36.315422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334b285-d6bd-44a4-ae2b-5c064df1c8c8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:36.321038 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:36.321673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:36.321951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:36.322221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:36.330753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:36.332546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:36.341036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 532/1060] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:36.348482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f352-0f1e-4ee4-83df-9f6e89ccd2bd None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:36.363051 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f352-0f1e-4ee4-83df-9f6e89ccd2bd None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:36.371181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875f10b-d698-42c5-abae-76edd507ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:36.372346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875f10b-d698-42c5-abae-76edd507ff78 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:36.372730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875f10b-d698-42c5-abae-76edd507ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:36.373002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875f10b-d698-42c5-abae-76edd507ff78 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:36.381179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875f10b-d698-42c5-abae-76edd507ff78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:36.383022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875f10b-d698-42c5-abae-76edd507ff78 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:36.398355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-f875f10b-d698-42c5-abae-76edd507ff78 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 03:18:36.399610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 529/1061] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:18:36 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:36.406820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:36.416757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60b3e-17dd-4be0-928c-0a145e426291 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:36.422350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f43e8-c47a-4b81-9105-31fe37ac5bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:36.423010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f43e8-c47a-4b81-9105-31fe37ac5bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:36.423290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f43e8-c47a-4b81-9105-31fe37ac5bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:36.423626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f43e8-c47a-4b81-9105-31fe37ac5bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:36.424350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f43e8-c47a-4b81-9105-31fe37ac5bb5 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:36.424655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f43e8-c47a-4b81-9105-31fe37ac5bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:36.426248 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f43e8-c47a-4b81-9105-31fe37ac5bb5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:36.434564 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 533/1062] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Aug 27 03:18:36 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:38.672427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ed9f-433b-4bfc-a132-57e5d06d082e None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:38.673260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ed9f-433b-4bfc-a132-57e5d06d082e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:38.673260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0ed9f-433b-4bfc-a132-57e5d06d082e None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:38.676207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 530/1063] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:38.686868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30098-4044-4534-9eb3-b3f03118613e None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:38.687606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30098-4044-4534-9eb3-b3f03118613e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:38.687826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30098-4044-4534-9eb3-b3f03118613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:38.715307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-01b30098-4044-4534-9eb3-b3f03118613e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:38.716532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-01b30098-4044-4534-9eb3-b3f03118613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:38.726037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 534/1064] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:38.751161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0ed9f-433b-4bfc-a132-57e5d06d082e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:38.767173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0ed9f-433b-4bfc-a132-57e5d06d082e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:38.773687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e698d4-042a-4248-8c0b-484e53377b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:38.774340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e698d4-042a-4248-8c0b-484e53377b92 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:38.774616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e698d4-042a-4248-8c0b-484e53377b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:38.774912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e698d4-042a-4248-8c0b-484e53377b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:38.775675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e698d4-042a-4248-8c0b-484e53377b92 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:38.776704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-82e698d4-042a-4248-8c0b-484e53377b92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:18:38.776704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:18:38.776704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:18:38.777577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e698d4-042a-4248-8c0b-484e53377b92 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:38.797373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 531/1065] 10.222.0.58 () {60 vars in 1160 bytes} [Fri Aug 27 03:18:38 2021] POST /identity/v3/domains => generated 267 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:40.915080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb703c-95e7-4abd-887a-5e74ac12593e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:40.916201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb703c-95e7-4abd-887a-5e74ac12593e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:40.916201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb703c-95e7-4abd-887a-5e74ac12593e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:40.918850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 535/1066] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:40.925747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2b114-427b-4df0-a8b5-c7cb264dbd15 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:40.926445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2b114-427b-4df0-a8b5-c7cb264dbd15 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:40.926565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2b114-427b-4df0-a8b5-c7cb264dbd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:40.956134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b9c2b114-427b-4df0-a8b5-c7cb264dbd15 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:40.957337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b9c2b114-427b-4df0-a8b5-c7cb264dbd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:41.019565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 532/1067] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:41.054999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb703c-95e7-4abd-887a-5e74ac12593e None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:41.077219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb703c-95e7-4abd-887a-5e74ac12593e None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:41.082091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d13c0-4176-4376-9756-bd65c9e019bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:41.082942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d13c0-4176-4376-9756-bd65c9e019bb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:41.083217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d13c0-4176-4376-9756-bd65c9e019bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:41.083501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d13c0-4176-4376-9756-bd65c9e019bb admin admin] PATH_INFO: `/v3/domains/cde117cdc7bd4dabbbcd930761275130` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:41.096665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d13c0-4176-4376-9756-bd65c9e019bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cde117cdc7bd4dabbbcd930761275130)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:41.098815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d13c0-4176-4376-9756-bd65c9e019bb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:41.100791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 536/1068] 10.222.0.58 () {56 vars in 1205 bytes} [Fri Aug 27 03:18:41 2021] GET /identity/v3/domains/cde117cdc7bd4dabbbcd930761275130 => generated 267 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:41.111643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2b114-427b-4df0-a8b5-c7cb264dbd15 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:41.125187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2b114-427b-4df0-a8b5-c7cb264dbd15 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:41.132764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2bba3-8174-4e62-aa1c-c4f36376816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:41.133434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2bba3-8174-4e62-aa1c-c4f36376816a admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:41.133817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2bba3-8174-4e62-aa1c-c4f36376816a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:41.134195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2bba3-8174-4e62-aa1c-c4f36376816a admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:41.135284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2bba3-8174-4e62-aa1c-c4f36376816a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:41.138112 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2bba3-8174-4e62-aa1c-c4f36376816a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:41.169662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 533/1069] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:18:41 2021] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:43.379432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e8a96-d5b9-4c04-b2c3-ea01c1e46e56 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:43.380339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e8a96-d5b9-4c04-b2c3-ea01c1e46e56 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:43.380339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e8a96-d5b9-4c04-b2c3-ea01c1e46e56 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:43.383158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 537/1070] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:43.389317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a2197-d0bb-4624-8a1f-a9e48a4b51dc None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:43.389735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a2197-d0bb-4624-8a1f-a9e48a4b51dc None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:43.390065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a2197-d0bb-4624-8a1f-a9e48a4b51dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:43.408193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-fe5a2197-d0bb-4624-8a1f-a9e48a4b51dc None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:43.409390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-fe5a2197-d0bb-4624-8a1f-a9e48a4b51dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:43.469204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 534/1071] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:43.496133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e8a96-d5b9-4c04-b2c3-ea01c1e46e56 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:43.512628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e8a96-d5b9-4c04-b2c3-ea01c1e46e56 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:43.519124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feb7ee-18e2-4eb2-90ff-d81e7b481336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:43.520010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb7ee-18e2-4eb2-90ff-d81e7b481336 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:43.520293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb7ee-18e2-4eb2-90ff-d81e7b481336 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:43.520553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb7ee-18e2-4eb2-90ff-d81e7b481336 admin admin] PATH_INFO: `/v3/domains/cde117cdc7bd4dabbbcd930761275130` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:43.521812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feb7ee-18e2-4eb2-90ff-d81e7b481336 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=cde117cdc7bd4dabbbcd930761275130)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:43.523812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feb7ee-18e2-4eb2-90ff-d81e7b481336 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:43.525406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 538/1072] 10.222.0.58 () {56 vars in 1205 bytes} [Fri Aug 27 03:18:43 2021] GET /identity/v3/domains/cde117cdc7bd4dabbbcd930761275130 => generated 267 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:43.531894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a2197-d0bb-4624-8a1f-a9e48a4b51dc None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:43.540957 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a2197-d0bb-4624-8a1f-a9e48a4b51dc None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:43.546420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf7d40-3af4-45ec-87b5-279763df3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:43.547081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7d40-3af4-45ec-87b5-279763df3254 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:43.547375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7d40-3af4-45ec-87b5-279763df3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:43.547666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf7d40-3af4-45ec-87b5-279763df3254 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:43.548379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf7d40-3af4-45ec-87b5-279763df3254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:43.550295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf7d40-3af4-45ec-87b5-279763df3254 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:43.574832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 535/1073] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:18:43 2021] POST /identity/v3/users => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:18:45.729871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acd7a-4af2-40fd-bf92-0b94fe6742dd None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:45.733401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acd7a-4af2-40fd-bf92-0b94fe6742dd None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:45.733401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acd7a-4af2-40fd-bf92-0b94fe6742dd None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:45.733824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 539/1074] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:45.743272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e20ca-cd32-4beb-a78d-f69533c819b9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:45.744071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e20ca-cd32-4beb-a78d-f69533c819b9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:45.744215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e20ca-cd32-4beb-a78d-f69533c819b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:45.775614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3d7e20ca-cd32-4beb-a78d-f69533c819b9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:45.777344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3d7e20ca-cd32-4beb-a78d-f69533c819b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:45.786758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 536/1075] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:45.812576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081acd7a-4af2-40fd-bf92-0b94fe6742dd None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:45.838810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081acd7a-4af2-40fd-bf92-0b94fe6742dd None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:45.846229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:45.847020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:45.847300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:45.847614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:45.859573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:45.866515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:45.867721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 540/1076] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:45.875162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e20ca-cd32-4beb-a78d-f69533c819b9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:45.889315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e20ca-cd32-4beb-a78d-f69533c819b9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:45.898692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:45.899795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:45.900252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:45.900707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:45.901905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:45.902400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:45.904998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:45.914641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 537/1077] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:45.924711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:45.939250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58c5de-36b1-4e56-a1ab-ee2a0d0134f4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:45.945685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:45.946540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:45.946811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:45.947077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] PATH_INFO: `/v3/users/d7b306af82c04083a425211dfe8127d1` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:45.962067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7b306af82c04083a425211dfe8127d1)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:45.964230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:45.965841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 541/1078] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:45 2021] GET /identity/v3/users/d7b306af82c04083a425211dfe8127d1 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:45.972981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:45.983165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5555fa-0b7e-41e7-9dac-88f7a2270bfe admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:45.989204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:45.989835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:45.990116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:45.990387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:45.998141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:46.000109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:46.008889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 538/1079] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:46.015270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:46.025653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80215-8b55-449a-b6a6-3275f1c3e336 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:46.031782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56c8f5-f682-490b-bf2a-f131b01f0199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:46.032624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56c8f5-f682-490b-bf2a-f131b01f0199 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:46.032900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56c8f5-f682-490b-bf2a-f131b01f0199 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:46.033167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56c8f5-f682-490b-bf2a-f131b01f0199 admin admin] PATH_INFO: `/v3/projects/09cd987f148b4be7a154da0ddc85394f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:46.035633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56c8f5-f682-490b-bf2a-f131b01f0199 admin admin] RBAC: Authorizing `identity:get_project(project_id=09cd987f148b4be7a154da0ddc85394f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:46.037647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56c8f5-f682-490b-bf2a-f131b01f0199 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:46.039283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 542/1080] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:46 2021] GET /identity/v3/projects/09cd987f148b4be7a154da0ddc85394f => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:46.049976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:46.063994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72085d41-85d4-4f92-8d88-4fb97ebc53ca admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:46.070586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8190d-a440-4cc8-9dc4-973026dae7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:46.071222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8190d-a440-4cc8-9dc4-973026dae7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:46.071542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8190d-a440-4cc8-9dc4-973026dae7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:46.071818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8190d-a440-4cc8-9dc4-973026dae7d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:46.072642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8190d-a440-4cc8-9dc4-973026dae7d2 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=09cd987f148b4be7a154da0ddc85394f, user.id=d7b306af82c04083a425211dfe8127d1) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:46.072953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8190d-a440-4cc8-9dc4-973026dae7d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:46.074770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8190d-a440-4cc8-9dc4-973026dae7d2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:46.080769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 539/1081] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:46 2021] GET /identity/v3/role_assignments?user.id=d7b306af82c04083a425211dfe8127d1&scope.project.id=09cd987f148b4be7a154da0ddc85394f&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:48.199326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b40a-b285-4667-a54a-ff0bc2d73649 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:48.199941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b40a-b285-4667-a54a-ff0bc2d73649 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:48.199941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b40a-b285-4667-a54a-ff0bc2d73649 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:48.203074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 543/1082] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:48.212441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647613-ad10-42a8-ab34-b4af86c3f534 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:48.212890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647613-ad10-42a8-ab34-b4af86c3f534 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:48.212987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647613-ad10-42a8-ab34-b4af86c3f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:48.232390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c0647613-ad10-42a8-ab34-b4af86c3f534 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:48.233600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c0647613-ad10-42a8-ab34-b4af86c3f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:48.243071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 540/1083] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:48.266864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3b40a-b285-4667-a54a-ff0bc2d73649 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:48.282674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3b40a-b285-4667-a54a-ff0bc2d73649 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:48.288830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:48.289610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:48.289887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:48.290175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:48.301933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:48.308847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:48.309978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 544/1084] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:48.317338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0647613-ad10-42a8-ab34-b4af86c3f534 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:48.332673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0647613-ad10-42a8-ab34-b4af86c3f534 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:48.341962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:48.343026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:48.343310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:48.343638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:48.344512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:48.344822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:48.346449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:48.359924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 541/1085] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:48.370059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:48.382621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d62af-4ab7-4cea-85e8-025d2d280a0d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:48.389215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:48.390071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:48.390368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:48.390573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] PATH_INFO: `/v3/users/d7b306af82c04083a425211dfe8127d1` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:48.391930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] RBAC: Authorizing `identity:get_user(user_id=d7b306af82c04083a425211dfe8127d1)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:48.394048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:48.395688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 545/1086] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:48 2021] GET /identity/v3/users/d7b306af82c04083a425211dfe8127d1 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:48.402841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:48.418596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185f95d-62a7-47ed-b472-d911775e5e1c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:48.425246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54d7e2-ce4a-479d-b0bf-82cb6ea11585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:48.426092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d7e2-ce4a-479d-b0bf-82cb6ea11585 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:48.426374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d7e2-ce4a-479d-b0bf-82cb6ea11585 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:48.426643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d7e2-ce4a-479d-b0bf-82cb6ea11585 admin admin] PATH_INFO: `/v3/projects/09cd987f148b4be7a154da0ddc85394f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:48.428046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54d7e2-ce4a-479d-b0bf-82cb6ea11585 admin admin] RBAC: Authorizing `identity:get_project(project_id=09cd987f148b4be7a154da0ddc85394f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:48.430110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54d7e2-ce4a-479d-b0bf-82cb6ea11585 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:48.431789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 542/1087] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:48 2021] GET /identity/v3/projects/09cd987f148b4be7a154da0ddc85394f => generated 361 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:48.438698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:48.449068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a11d29-4f3c-4bfc-a1e8-46e03e395f9a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:48.455783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fb79e-bd51-4d3b-8caf-cd927090ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:48.456604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb79e-bd51-4d3b-8caf-cd927090ad62 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:48.456878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb79e-bd51-4d3b-8caf-cd927090ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:48.457148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb79e-bd51-4d3b-8caf-cd927090ad62 admin admin] PATH_INFO: `/v3/projects/09cd987f148b4be7a154da0ddc85394f/users/d7b306af82c04083a425211dfe8127d1/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:48.459599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fb79e-bd51-4d3b-8caf-cd927090ad62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cd987f148b4be7a154da0ddc85394f, user_id=d7b306af82c04083a425211dfe8127d1, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:48.462181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fb79e-bd51-4d3b-8caf-cd927090ad62 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:48.478126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 546/1088] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:18:48 2021] PUT /identity/v3/projects/09cd987f148b4be7a154da0ddc85394f/users/d7b306af82c04083a425211dfe8127d1/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:18:50.563597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9648-2b6f-417c-b837-c2cdfd82f650 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.564163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9648-2b6f-417c-b837-c2cdfd82f650 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.564163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9648-2b6f-417c-b837-c2cdfd82f650 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.566958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 543/1089] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:18:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:18:50.577527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e682a-212e-41ae-8f40-7d9a45c426c5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.578281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e682a-212e-41ae-8f40-7d9a45c426c5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.578406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e682a-212e-41ae-8f40-7d9a45c426c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.602466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c67e682a-212e-41ae-8f40-7d9a45c426c5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:18:50.603692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c67e682a-212e-41ae-8f40-7d9a45c426c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:18:50.665327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 547/1090] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:18:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:18:50.691118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9648-2b6f-417c-b837-c2cdfd82f650 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:50.708578 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9648-2b6f-417c-b837-c2cdfd82f650 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:50.713050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:50.713834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.714116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.714388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.726546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:18:50.733386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:18:50.734547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 544/1091] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:18:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:18:50.745019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e682a-212e-41ae-8f40-7d9a45c426c5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:50.759519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e682a-212e-41ae-8f40-7d9a45c426c5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:50.766905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:50.767600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.767875 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.768144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.768895 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:50.769198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:50.770786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:50.779890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 548/1092] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:18:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:50.786536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:50.798292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258d353-03ce-4e18-9e9b-cba1a4102b40 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:50.803004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:50.803909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.804193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.804466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] PATH_INFO: `/v3/users/d7b306af82c04083a425211dfe8127d1` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.805748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7b306af82c04083a425211dfe8127d1)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:50.808251 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:50.809837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 545/1093] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:18:50 2021] GET /identity/v3/users/d7b306af82c04083a425211dfe8127d1 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:50.816253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:50.825904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53362af-203b-4cd9-85d1-a7bfea5eabef admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:50.830698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:50.831318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.831618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.831894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.839608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:50.841323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:50.850220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 549/1094] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:18:50 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:18:50.856703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:50.872531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1027-af51-4fa5-a341-546dc183ffb9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:50.880538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b68f2-74ff-423a-a830-71705706acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:50.881747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b68f2-74ff-423a-a830-71705706acd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.882135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b68f2-74ff-423a-a830-71705706acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.882505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b68f2-74ff-423a-a830-71705706acd2 admin admin] PATH_INFO: `/v3/projects/09cd987f148b4be7a154da0ddc85394f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.884570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b68f2-74ff-423a-a830-71705706acd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=09cd987f148b4be7a154da0ddc85394f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:50.887819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b68f2-74ff-423a-a830-71705706acd2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:50.890249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 546/1095] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:18:50 2021] GET /identity/v3/projects/09cd987f148b4be7a154da0ddc85394f => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:18:50.900479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:18:50.914660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332130-7dfb-4c8b-87fd-608147526deb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:18:50.922733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbadc0e-b914-42cc-82b2-3d9f834a8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:18:50.923297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbadc0e-b914-42cc-82b2-3d9f834a8d83 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:18:50.923618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbadc0e-b914-42cc-82b2-3d9f834a8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:18:50.923893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbadc0e-b914-42cc-82b2-3d9f834a8d83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:18:50.924720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbadc0e-b914-42cc-82b2-3d9f834a8d83 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=09cd987f148b4be7a154da0ddc85394f, user.id=d7b306af82c04083a425211dfe8127d1) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:18:50.925040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbadc0e-b914-42cc-82b2-3d9f834a8d83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:18:50.926843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbadc0e-b914-42cc-82b2-3d9f834a8d83 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:18:50.935717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 550/1096] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:18:50 2021] GET /identity/v3/role_assignments?user.id=d7b306af82c04083a425211dfe8127d1&scope.project.id=09cd987f148b4be7a154da0ddc85394f&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:46.097455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39885b-1588-42ad-89f4-d4da766175fd None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:46.098075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39885b-1588-42ad-89f4-d4da766175fd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:46.098075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39885b-1588-42ad-89f4-d4da766175fd None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:46.099875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 547/1097] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:19:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:19:46.106626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c591-fbff-4890-97c4-007b046cf424 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:46.107308 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c591-fbff-4890-97c4-007b046cf424 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:46.107457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c591-fbff-4890-97c4-007b046cf424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:46.128280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c5d6c591-fbff-4890-97c4-007b046cf424 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:19:46.129708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c5d6c591-fbff-4890-97c4-007b046cf424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:19:46.139474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 551/1098] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:19:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:19:46.164452 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39885b-1588-42ad-89f4-d4da766175fd None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:46.178401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39885b-1588-42ad-89f4-d4da766175fd None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:46.183958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:46.185047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:46.185353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:46.185690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:46.199112 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:46.201534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:46.228723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:46.235759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 548/1099] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:46.237014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c591-fbff-4890-97c4-007b046cf424 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:46.247534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c591-fbff-4890-97c4-007b046cf424 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:46.253481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaeacc8-7108-480b-bacb-c664fd156b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:46.254327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeacc8-7108-480b-bacb-c664fd156b14 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:46.254624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeacc8-7108-480b-bacb-c664fd156b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:46.254916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeacc8-7108-480b-bacb-c664fd156b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:46.255967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaeacc8-7108-480b-bacb-c664fd156b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:46.256508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaeacc8-7108-480b-bacb-c664fd156b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:46.258343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaeacc8-7108-480b-bacb-c664fd156b14 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:46.273198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 552/1100] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:46.281983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:46.293262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd242cc-bce1-4da2-8b5e-32849127f870 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:46.301549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b63b67-8aa5-4d9b-aa38-c556bf118423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:46.302750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b63b67-8aa5-4d9b-aa38-c556bf118423 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:46.303123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b63b67-8aa5-4d9b-aa38-c556bf118423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:46.303615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b63b67-8aa5-4d9b-aa38-c556bf118423 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:46.304823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b63b67-8aa5-4d9b-aa38-c556bf118423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:46.307248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b63b67-8aa5-4d9b-aa38-c556bf118423 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:46.334376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 549/1101] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Aug 27 03:19:46 2021] POST /identity/v3/users => generated 251 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:19:48.738986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095106d-9af6-4ffa-8190-64b653e31acd None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:48.739655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095106d-9af6-4ffa-8190-64b653e31acd None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:48.739655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095106d-9af6-4ffa-8190-64b653e31acd None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:48.741923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 553/1102] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:19:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:19:48.748779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb28a2-e861-4311-b992-d043419ba5d8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:48.749247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb28a2-e861-4311-b992-d043419ba5d8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:48.749487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb28a2-e861-4311-b992-d043419ba5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:48.768351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b6bb28a2-e861-4311-b992-d043419ba5d8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:19:48.769603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b6bb28a2-e861-4311-b992-d043419ba5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:19:48.779127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 550/1103] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:19:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:19:48.806292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095106d-9af6-4ffa-8190-64b653e31acd None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:48.820286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095106d-9af6-4ffa-8190-64b653e31acd None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:48.825511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:48.826432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:48.826758 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:48.827041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:48.839585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:19:48.847965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:19:48.849588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 554/1104] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:19:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:48.858304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb28a2-e861-4311-b992-d043419ba5d8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:48.869144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb28a2-e861-4311-b992-d043419ba5d8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:48.876036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:48.876724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:48.877047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:48.877537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:48.878306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:48.878728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:48.880719 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:48.890838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 551/1105] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:19:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:48.897893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:48.908274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b390d3-03bb-41ac-b8ce-8c9456943580 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:48.914147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:48.915174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:48.915528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:48.915809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:48.931156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:48.933522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:48.956307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:48.958131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 555/1106] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:19:48.966543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:48.977895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5b611-78df-45e9-8d78-ea581fc5d3ea admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:48.983512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:48.984176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:48.984456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:48.984747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:48.985610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:48.985945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:48.987904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.000856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 552/1107] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:19:49.008377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.019645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc272a-9cd6-4ffb-9d44-b038c8ac365d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.025487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.026459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.026760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.027096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.037466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.039620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.057290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:19:49.065081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 556/1108] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:49.066881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.078109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d5768-7f92-4490-965f-f66a5c97f550 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.083944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.084768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.085082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.085409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.086440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:49.086857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.089188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.111590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 553/1109] 10.222.0.58 () {56 vars in 1165 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:19:49.122404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.134627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc1a6-1c5b-4a4a-b341-333c3b96f9bc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.140354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.141019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.141399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.141663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.151527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.153996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.167053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 557/1110] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:19:49.174738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.186414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e2a01-29bc-48fa-9af4-9a88425aeed4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.191278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.192262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.192618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.192980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.205221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.207287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.225546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:49.226989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 554/1111] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:49.234141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.243584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6efe6-9651-4d93-aaf0-d02c0d10430a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.249810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.250469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.250759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.251084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.251794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:49.252211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.253980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.272947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 558/1112] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:49.274218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.286738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2591ef-a83f-4af8-a164-553fd39a2fac admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.293396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.294799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.295276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.295820 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.304378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.306600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.321535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:19:49.328163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 555/1113] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:49.329537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.340474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de916138-adcf-4a66-ae55-b113de044c86 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.346392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8fb1e-fcc7-442c-b40a-4ef832a3da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.347109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8fb1e-fcc7-442c-b40a-4ef832a3da66 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.347456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8fb1e-fcc7-442c-b40a-4ef832a3da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.347749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8fb1e-fcc7-442c-b40a-4ef832a3da66 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.348653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8fb1e-fcc7-442c-b40a-4ef832a3da66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:49.349037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8fb1e-fcc7-442c-b40a-4ef832a3da66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.351020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8fb1e-fcc7-442c-b40a-4ef832a3da66 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.365106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 559/1114] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:49.372471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:49.383596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3098-fa53-4458-91a9-59baad9e801d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:49.388781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced85d8-d372-4c90-96fc-ad63eed144ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:49.389496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced85d8-d372-4c90-96fc-ad63eed144ec admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:49.389872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced85d8-d372-4c90-96fc-ad63eed144ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:49.393028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced85d8-d372-4c90-96fc-ad63eed144ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:49.393028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced85d8-d372-4c90-96fc-ad63eed144ec admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=58838486fa5f49c4bca67ad01713fefd) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:49.393028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced85d8-d372-4c90-96fc-ad63eed144ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:49.393550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced85d8-d372-4c90-96fc-ad63eed144ec admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:49.407400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 556/1115] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:19:49 2021] GET /identity/v3/role_assignments?user.id=58838486fa5f49c4bca67ad01713fefd&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:51.707451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f3f2-c6c2-48fb-aec1-2509130a1539 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:51.708111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f3f2-c6c2-48fb-aec1-2509130a1539 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:51.708207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f3f2-c6c2-48fb-aec1-2509130a1539 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:51.710221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 560/1116] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:19:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:19:51.716497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352568dd-1e7c-4b8d-b8f9-08ec1f6d1174 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:51.717000 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352568dd-1e7c-4b8d-b8f9-08ec1f6d1174 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:51.717137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352568dd-1e7c-4b8d-b8f9-08ec1f6d1174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:51.737132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-352568dd-1e7c-4b8d-b8f9-08ec1f6d1174 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:19:51.738345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-352568dd-1e7c-4b8d-b8f9-08ec1f6d1174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:19:51.746746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 557/1117] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:19:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:19:51.771049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3f3f2-c6c2-48fb-aec1-2509130a1539 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:51.784349 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3f3f2-c6c2-48fb-aec1-2509130a1539 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:51.789124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:51.789974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:51.790262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:51.791816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:51.803305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:19:51.811279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:19:51.812605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 561/1118] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:19:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:19:51.819680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352568dd-1e7c-4b8d-b8f9-08ec1f6d1174 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:51.833787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352568dd-1e7c-4b8d-b8f9-08ec1f6d1174 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:51.839077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:51.839780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:51.840207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:51.840847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:51.841409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:51.841729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:51.843695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:51.852729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 558/1119] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:19:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:19:51.859230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:51.872588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca03f43-f143-4605-914d-2df4d9b00f6d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:51.878534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:51.879605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:51.880006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:51.880292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:51.893094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:51.895513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:51.917429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:51.919317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 562/1120] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:51.927607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:51.938899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad000a5c-ddd3-41f5-8a3e-8af14f06ac32 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:51.944381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:51.945250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:51.945560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:51.945837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:51.946606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:51.946970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:51.948947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:51.963256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 559/1121] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:51.969982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:51.980237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0181cf-069c-46c1-a57b-3a3c0f0a0602 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:51.985530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:51.986330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:51.986598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:51.986863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:51.995188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:51.997651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:52.012326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:19:52.013771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 563/1122] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:51 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:52.020963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:52.031642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859238-58e4-462a-a462-f3d82d50fb41 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:52.036294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:52.037022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:52.037298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:52.037567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:52.038453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:52.038757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:52.040631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:52.059729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 560/1123] 10.222.0.58 () {56 vars in 1165 bytes} [Fri Aug 27 03:19:52 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:52.066353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:52.077585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377c09-1d07-4d42-b684-68eba9f5eb2e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:52.082457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:52.083253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:52.083569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:52.083841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:52.094548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:52.096411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:52.114193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:52.115392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 564/1124] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:52.123041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:52.135004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2f31e-85f3-4b10-86fb-ed02b8e3f6dd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:52.142287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:52.143041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:52.143370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:52.143652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:52.144467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:52.144795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:52.146611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:52.160007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 561/1125] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:52.166765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:52.178520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bee59-45d3-4955-8b75-765208204908 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:52.183490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:52.184955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:52.185240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:52.185524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:52.192837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:52.194795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:52.209105 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:19:52.210289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 565/1126] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:19:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:19:52.217261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:52.227493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323415c3-df98-4ec6-876e-f288e7178ff9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:52.232728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de4692-4b0d-42ee-8558-b8d52d8f0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:52.233547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de4692-4b0d-42ee-8558-b8d52d8f0834 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:52.233893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de4692-4b0d-42ee-8558-b8d52d8f0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:52.234167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de4692-4b0d-42ee-8558-b8d52d8f0834 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:52.234963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de4692-4b0d-42ee-8558-b8d52d8f0834 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:52.235272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de4692-4b0d-42ee-8558-b8d52d8f0834 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:52.237294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de4692-4b0d-42ee-8558-b8d52d8f0834 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:52.253064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 562/1127] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:19:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:52.260295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:52.271841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4cad-0058-4eb0-b631-d3344ac59c15 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:52.277275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4257c2-6b18-44c4-9ef2-deb982a87b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:52.278257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4257c2-6b18-44c4-9ef2-deb982a87b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:52.278584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4257c2-6b18-44c4-9ef2-deb982a87b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:52.278883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4257c2-6b18-44c4-9ef2-deb982a87b81 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/58838486fa5f49c4bca67ad01713fefd/roles/fe4243b37e174c0c856029d03e170fac` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:52.294103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4257c2-6b18-44c4-9ef2-deb982a87b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=58838486fa5f49c4bca67ad01713fefd, role_id=fe4243b37e174c0c856029d03e170fac)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:52.296784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4257c2-6b18-44c4-9ef2-deb982a87b81 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:52.309869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 566/1128] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:19:52 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/58838486fa5f49c4bca67ad01713fefd/roles/fe4243b37e174c0c856029d03e170fac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:19:54.793646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3662-0c61-4b25-9641-1aa2c9e0d240 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:54.794201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3662-0c61-4b25-9641-1aa2c9e0d240 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:54.794201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3662-0c61-4b25-9641-1aa2c9e0d240 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:54.796002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 563/1129] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:19:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:19:54.802354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf18fe-1875-4818-9f13-e8f82b140183 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:54.802791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf18fe-1875-4818-9f13-e8f82b140183 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:54.802917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf18fe-1875-4818-9f13-e8f82b140183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:54.824201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b1cf18fe-1875-4818-9f13-e8f82b140183 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:19:54.825416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b1cf18fe-1875-4818-9f13-e8f82b140183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:19:54.887576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 567/1130] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:19:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:19:54.912722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf3662-0c61-4b25-9641-1aa2c9e0d240 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:54.928800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf3662-0c61-4b25-9641-1aa2c9e0d240 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:54.934881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:54.935764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:54.936544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:54.936849 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:54.951591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:19:54.959694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 03:19:54.961098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 564/1131] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Aug 27 03:19:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:54.969082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf18fe-1875-4818-9f13-e8f82b140183 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:54.978991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf18fe-1875-4818-9f13-e8f82b140183 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:54.984731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:54.985400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:54.985680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:54.985952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:54.986711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:54.987021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:54.988673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:54.998260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 568/1132] 10.222.0.58 () {56 vars in 1125 bytes} [Fri Aug 27 03:19:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:19:55.004728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.015448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c00ce1-bcf4-462d-9ab9-45816b760b3d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.020196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.020977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.021248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.021513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.032587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.034579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.054248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:55.055700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 565/1133] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:55.063343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.074637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b1582-2dda-40c3-8495-ec1017aeddd3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.079723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.080368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.080680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.080920 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.081720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:55.082075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.083978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.097715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 569/1134] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:55.104983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.115620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7332-b0a7-4332-82a2-0a22acd6f0a9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.121591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.122924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.123491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.123928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.134828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.138447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.156127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:19:55.157475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 566/1135] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:55.165979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.177397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87d566-3364-441e-ad05-ddde6cf93e12 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.184282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.184749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.185025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.185432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.186272 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:55.186579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.188698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.208146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 570/1136] 10.222.0.58 () {56 vars in 1165 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:55.215483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.227542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1e77a-b3b1-491e-901b-118200963b56 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.233043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.233683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.233969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.234236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.243747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.245880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.256504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 567/1137] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:19:55.264225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.276582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8ee5-d02b-49b0-8cba-669586dfd8cf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.282732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.283558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.283843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.284117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.297378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.299226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.317655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:55.318841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 571/1138] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:19:55.326261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.340986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ad27b-7864-4893-a525-4803ca77073c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.347971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.348116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.348326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.348603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.349349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:55.349659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.351497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.364826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 568/1139] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:19:55.372336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.384286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c716380-9827-4226-bb89-ff7f6eed9c08 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.389522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.390413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.390696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.390975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.400370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.402618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.418867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:19:55.425470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 572/1140] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:19:55.426961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.439113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570a381-68b5-4454-8594-47a17db5df68 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.445422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e13ea-92c1-40b5-9bb6-2fa52b59cdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.446134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e13ea-92c1-40b5-9bb6-2fa52b59cdbd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.446410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e13ea-92c1-40b5-9bb6-2fa52b59cdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.446715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e13ea-92c1-40b5-9bb6-2fa52b59cdbd admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.447630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e13ea-92c1-40b5-9bb6-2fa52b59cdbd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:55.447981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e13ea-92c1-40b5-9bb6-2fa52b59cdbd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.450581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e13ea-92c1-40b5-9bb6-2fa52b59cdbd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.465921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 569/1141] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:55.473489 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:55.486963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df968a50-c94c-4311-906f-7d7559f3e989 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:55.492602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c364a-3027-49fa-a219-6bae169fa746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:55.493292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c364a-3027-49fa-a219-6bae169fa746 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:55.493612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c364a-3027-49fa-a219-6bae169fa746 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:55.493933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c364a-3027-49fa-a219-6bae169fa746 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:55.494888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c364a-3027-49fa-a219-6bae169fa746 admin admin] RBAC: Adding query filter params (role.id=fe4243b37e174c0c856029d03e170fac, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=58838486fa5f49c4bca67ad01713fefd) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:55.495195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c364a-3027-49fa-a219-6bae169fa746 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:55.497307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c364a-3027-49fa-a219-6bae169fa746 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:55.503978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 573/1142] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:19:55 2021] GET /identity/v3/role_assignments?user.id=58838486fa5f49c4bca67ad01713fefd&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=fe4243b37e174c0c856029d03e170fac => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:57.787934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cea69d-1057-4a09-bbce-ca0e12af90ff None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:57.788543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cea69d-1057-4a09-bbce-ca0e12af90ff None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:57.788543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cea69d-1057-4a09-bbce-ca0e12af90ff None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:57.790389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 570/1143] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:19:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:19:57.797112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e8b4e-da5c-47a8-878b-4e659be38b9f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:57.797574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e8b4e-da5c-47a8-878b-4e659be38b9f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:57.797665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e8b4e-da5c-47a8-878b-4e659be38b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:57.815954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-662e8b4e-da5c-47a8-878b-4e659be38b9f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:19:57.817336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-662e8b4e-da5c-47a8-878b-4e659be38b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:19:57.826836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 574/1144] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:19:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:19:57.862005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cea69d-1057-4a09-bbce-ca0e12af90ff None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:57.875764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cea69d-1057-4a09-bbce-ca0e12af90ff None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:57.881516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:57.882490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:57.882872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:57.883224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:57.896635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:19:57.905568 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:19:57.906847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 571/1145] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:19:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:57.914618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e8b4e-da5c-47a8-878b-4e659be38b9f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:57.924286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e8b4e-da5c-47a8-878b-4e659be38b9f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:57.929925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:57.930952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:57.931141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:57.931539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:57.932698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:57.933004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:57.935198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:57.944082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 575/1146] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:19:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:57.951231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:57.961142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97383360-2a15-4619-9772-02c49d15eb35 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:57.966239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:57.967015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:57.967287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:57.967580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:57.978418 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:57.980422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:57.998134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:57.999385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 572/1147] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:19:58.006209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.016244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bcd56-7fa4-492d-8a8e-86162d5dd911 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.020805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.021502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.021738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.022013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.022795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:58.023095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.024736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.036943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 576/1148] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:58.044798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.054234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f9f1b-641c-46b6-9be7-1e8c5eae8ce3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.062335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.063255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.063567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.063885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.072927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.075150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.088988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:19:58.090452 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 573/1149] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:58.097377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.107313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce00594-f369-40bd-91e8-a338e9d70517 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.111954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.112620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.112895 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.113170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.114047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:58.114355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.116238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.135355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 577/1150] 10.222.0.58 () {56 vars in 1165 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:58.142211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.153542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6f9f5-e238-48ab-8987-6c5f4794d7ec admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.158812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.159537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.159863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.160081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.168561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.170342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.186058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 574/1151] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:19:58.187643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.197925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601d6d-b51d-4af4-8cfc-a29cd23f8739 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.203219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.204085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.204359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.204631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.216185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.218153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.242261 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:19:58.244984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 578/1152] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:58.250177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.263872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7477-d672-484a-a7ce-91be3eaad9c6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.268895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.269550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.269827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.270096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.270843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:58.271144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.272780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.285920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 575/1153] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:19:58.292354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.303120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795975-63d8-4bd0-8d48-65335629e534 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.308752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.309903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.310206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.310562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.318527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.320527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.341416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:19:58.341416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 579/1154] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:19:58.342618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.353974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125c3f1-bff8-45e1-a409-7ffc32317026 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.359405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c391-1359-4933-b5f6-00a038c58523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.360144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c391-1359-4933-b5f6-00a038c58523 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.360486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c391-1359-4933-b5f6-00a038c58523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.360891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c391-1359-4933-b5f6-00a038c58523 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.361784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c391-1359-4933-b5f6-00a038c58523 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:58.362192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c391-1359-4933-b5f6-00a038c58523 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.364468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c391-1359-4933-b5f6-00a038c58523 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.378920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 576/1155] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:19:58.385608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:19:58.396728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dd05e-fa4a-4222-b250-cd3c25bd83c7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:19:58.401999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24334eae-1420-4767-b1a1-743d1f26a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:19:58.402737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24334eae-1420-4767-b1a1-743d1f26a31a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:19:58.403034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24334eae-1420-4767-b1a1-743d1f26a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:19:58.403330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24334eae-1420-4767-b1a1-743d1f26a31a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:19:58.404200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24334eae-1420-4767-b1a1-743d1f26a31a admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=58838486fa5f49c4bca67ad01713fefd) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:19:58.404550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24334eae-1420-4767-b1a1-743d1f26a31a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:19:58.406528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24334eae-1420-4767-b1a1-743d1f26a31a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:19:58.412374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 580/1156] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:19:58 2021] GET /identity/v3/role_assignments?user.id=58838486fa5f49c4bca67ad01713fefd&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:00.665847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e346f-a359-495f-bab4-2fab3ad1d15a None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:00.666421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e346f-a359-495f-bab4-2fab3ad1d15a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:00.667102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e346f-a359-495f-bab4-2fab3ad1d15a None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:00.669082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 577/1157] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:20:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:20:00.675842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c532d0-bb7a-4be7-9cfb-bab2835b6d2a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:00.676380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c532d0-bb7a-4be7-9cfb-bab2835b6d2a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:00.676527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c532d0-bb7a-4be7-9cfb-bab2835b6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:00.694997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a7c532d0-bb7a-4be7-9cfb-bab2835b6d2a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:20:00.696305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a7c532d0-bb7a-4be7-9cfb-bab2835b6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:20:00.705250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 581/1158] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:20:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:20:00.736384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e346f-a359-495f-bab4-2fab3ad1d15a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:00.749520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e346f-a359-495f-bab4-2fab3ad1d15a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:00.753811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:00.754593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:00.754950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:00.755226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:00.767050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:20:00.774181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:20:00.775407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 578/1159] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:20:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:00.782939 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c532d0-bb7a-4be7-9cfb-bab2835b6d2a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:00.793228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c532d0-bb7a-4be7-9cfb-bab2835b6d2a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:00.799463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:00.800136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:00.800434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:00.800706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:00.801625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:00.801979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:00.803763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:00.813654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 582/1160] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:20:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:00.820333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:00.831934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b043e-3a16-4ffd-b30c-e6fa7c72b181 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:00.836758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:00.837629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:00.837903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:00.838174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:00.849879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:00.851751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:00.868914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:20:00.870123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 579/1161] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:20:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:20:00.878117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:00.888402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92f603-7131-429d-961e-b5ee1eb2b753 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:00.893473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:00.894146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:00.894405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:00.894676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:00.895424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:00.895730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:00.897530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:00.910500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 583/1162] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:20:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:00.919963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:00.936446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd853-3b7a-4385-8565-a17c50a8f348 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:00.944322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:00.945158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:00.945475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:00.945704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:00.958897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:00.961492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:00.979193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:20:00.987548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 580/1163] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:20:00 2021] GET /identity/v3/users/placement => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 03:20:00.988562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:01.000315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd046-7bb1-48ee-8a01-f6b37f8564d4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:01.005664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:01.006381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:01.006665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:01.006940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:01.007864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:01.008178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:01.010132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:01.036948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 584/1164] 10.222.0.58 () {56 vars in 1165 bytes} [Fri Aug 27 03:20:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:01.044510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:01.057654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf09b5-c983-4929-84ed-3c6bbbaccdec admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:01.063820 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:01.064912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:01.065228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:01.065579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:01.078158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:01.080135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:01.100997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:20:01.102250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 581/1165] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:20:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:01.110441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:01.121981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df7340-4b5c-4f43-b54f-5a90daa0d7f4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:01.128022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:01.128869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:01.129159 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:01.129431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:01.130375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:01.130698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:01.132521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:01.148230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 585/1166] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:20:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:20:01.155597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:01.167853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300146f-a1e8-4d7a-8c35-fcf88413c90d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:01.173974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:01.174853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:01.175195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:01.175591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:01.184190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:01.186179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:01.204299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:20:01.205916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 582/1167] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:20:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:01.213334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:01.224864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c9c03-1051-4f37-bb7c-690f8a31f472 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:01.230791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93300f5-faae-4252-b943-2ecc73bc10b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:01.231801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93300f5-faae-4252-b943-2ecc73bc10b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:01.232120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93300f5-faae-4252-b943-2ecc73bc10b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:01.232482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93300f5-faae-4252-b943-2ecc73bc10b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:01.233402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93300f5-faae-4252-b943-2ecc73bc10b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:01.233719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93300f5-faae-4252-b943-2ecc73bc10b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:01.236077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93300f5-faae-4252-b943-2ecc73bc10b6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:01.250909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 586/1168] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:20:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:01.258709 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:01.272102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f8770-adfe-420f-ae6f-07e937624bad admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:01.278297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a638d-bbc3-4f32-992c-ddf101be4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:01.279330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a638d-bbc3-4f32-992c-ddf101be4ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:01.279683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a638d-bbc3-4f32-992c-ddf101be4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:01.279960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a638d-bbc3-4f32-992c-ddf101be4ab4 admin admin] PATH_INFO: `/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/58838486fa5f49c4bca67ad01713fefd/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:01.282133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a638d-bbc3-4f32-992c-ddf101be4ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7671c5ef4cc4e349a81068be7439863, user_id=58838486fa5f49c4bca67ad01713fefd, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:01.285667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a638d-bbc3-4f32-992c-ddf101be4ab4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:01.300347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 583/1169] 10.222.0.58 () {58 vars in 1461 bytes} [Fri Aug 27 03:20:01 2021] PUT /identity/v3/projects/b7671c5ef4cc4e349a81068be7439863/users/58838486fa5f49c4bca67ad01713fefd/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:20:03.652348 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776e1d-4c93-42ed-b46d-fe207de3cf0c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:03.653187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776e1d-4c93-42ed-b46d-fe207de3cf0c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:03.653574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776e1d-4c93-42ed-b46d-fe207de3cf0c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:03.656371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 587/1170] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:20:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:20:03.665261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07f39-cd5c-4440-b400-77c169917b29 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:03.665705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07f39-cd5c-4440-b400-77c169917b29 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:03.665814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf07f39-cd5c-4440-b400-77c169917b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:03.686457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ddf07f39-cd5c-4440-b400-77c169917b29 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:20:03.687669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ddf07f39-cd5c-4440-b400-77c169917b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:20:03.770989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 584/1171] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:20:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:20:03.798150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776e1d-4c93-42ed-b46d-fe207de3cf0c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:03.814134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776e1d-4c93-42ed-b46d-fe207de3cf0c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:03.820010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:03.820841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:03.821129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:03.821407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:03.833854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 03:20:03.841455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 03:20:03.842715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 588/1172] 10.222.0.58 () {56 vars in 1118 bytes} [Fri Aug 27 03:20:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:03.851834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07f39-cd5c-4440-b400-77c169917b29 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:03.866063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf07f39-cd5c-4440-b400-77c169917b29 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:03.873751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:03.874405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:03.874680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:03.874972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:03.875754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:03.876057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:03.877663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:03.887453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 585/1173] 10.222.0.58 () {56 vars in 1121 bytes} [Fri Aug 27 03:20:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:03.894591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:03.909568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a8b72-0279-4d08-b080-f2fecf2e97b2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:03.915381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:03.916173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:03.916454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:03.916723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:03.929721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:03.931591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:03.950761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:20:03.952314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 589/1174] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:20:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:03.959523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:03.971974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4663691-1cd1-49d6-9e30-ef8db8a59c1e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:03.978665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:03.979311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:03.979628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:03.979894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:03.980607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:03.980915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:03.982493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:03.994745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 586/1175] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:20:04.004784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.020857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bde4d8-4e71-42b8-898b-5710f8df2b08 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.028840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.029624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.029906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.030185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.037825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.039871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.055818 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 03:20:04.057303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 590/1176] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:04.064278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.080167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81326-dce8-4b11-9152-e936939e5e91 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.088937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.090103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.090340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.090601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.091485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:04.091790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.093629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.111460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 587/1177] 10.222.0.58 () {56 vars in 1165 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:04.120711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.130455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b00654-726f-4ce5-931e-37b29f468bb5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.135916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.136639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.136921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.137210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.145188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.146906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.156665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 591/1178] 10.222.0.58 () {58 vars in 1325 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:20:04.169301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.187816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5a4d0-0243-4e65-8974-53188a444934 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.194759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.195589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.195866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.196131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.208075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.209917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.226946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 03:20:04.228128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 588/1179] 10.222.0.58 () {56 vars in 1130 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:04.237702 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.252434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c133-8c53-47df-ad57-8fa6525a352c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.261211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.262210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.262485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.262749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.263497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:04.263799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.265372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.277781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 592/1180] 10.222.0.58 () {56 vars in 1131 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:04.287430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.299881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf55a3-6de5-4092-ab1a-cb9b8ce83d99 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.305109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.305882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.306160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.306429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.314603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.316576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.329878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING keystone.server.flask.application [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 03:20:04.330995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 589/1181] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:04.337467 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.348130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cda64-7f92-4f1a-bdf9-f453db7042e7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.353836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402931bc-50ff-40dd-961a-959b76363b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.354476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402931bc-50ff-40dd-961a-959b76363b66 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.354754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402931bc-50ff-40dd-961a-959b76363b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.355023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402931bc-50ff-40dd-961a-959b76363b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.355917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402931bc-50ff-40dd-961a-959b76363b66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:04.356227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402931bc-50ff-40dd-961a-959b76363b66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.358055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402931bc-50ff-40dd-961a-959b76363b66 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.370691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 593/1182] 10.222.0.58 () {56 vars in 1170 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:04.378070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:04.389737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9134be-6618-4d3f-aee3-2169e449634e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:04.394996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa38cfc-909f-4b8a-8f92-1503f3f3bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:04.395491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa38cfc-909f-4b8a-8f92-1503f3f3bbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:04.395774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa38cfc-909f-4b8a-8f92-1503f3f3bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:04.396048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa38cfc-909f-4b8a-8f92-1503f3f3bbd9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:04.396879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa38cfc-909f-4b8a-8f92-1503f3f3bbd9 admin admin] RBAC: Adding query filter params (role.id=723f92c5421e4848a33b9ec1aa718b2d, scope.project.id=b7671c5ef4cc4e349a81068be7439863, user.id=58838486fa5f49c4bca67ad01713fefd) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:04.397186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa38cfc-909f-4b8a-8f92-1503f3f3bbd9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:04.399034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa38cfc-909f-4b8a-8f92-1503f3f3bbd9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:04.405453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 590/1183] 10.222.0.58 () {56 vars in 1396 bytes} [Fri Aug 27 03:20:04 2021] GET /identity/v3/role_assignments?user.id=58838486fa5f49c4bca67ad01713fefd&scope.project.id=b7671c5ef4cc4e349a81068be7439863&role.id=723f92c5421e4848a33b9ec1aa718b2d => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:06.716675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e524-e49a-45ce-a280-0c2b717d137e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:06.717571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e524-e49a-45ce-a280-0c2b717d137e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:06.717571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4e524-e49a-45ce-a280-0c2b717d137e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:06.720771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 594/1184] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:20:06 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:20:06.726823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f893-7214-4dfd-8477-2c433e04366e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:06.727250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f893-7214-4dfd-8477-2c433e04366e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:06.727384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f893-7214-4dfd-8477-2c433e04366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:06.746582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b071f893-7214-4dfd-8477-2c433e04366e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:20:06.747778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b071f893-7214-4dfd-8477-2c433e04366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:20:06.756377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 591/1185] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:20:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:20:06.780990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e524-e49a-45ce-a280-0c2b717d137e None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:06.803043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4e524-e49a-45ce-a280-0c2b717d137e None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:06.811020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:06.811847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:06.812124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:06.812394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:06.813046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:06.814637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:06.826330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 03:20:06.827508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 595/1186] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:20:06 2021] GET /identity/v3/services/placement => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:06.837931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f893-7214-4dfd-8477-2c433e04366e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:06.848450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f893-7214-4dfd-8477-2c433e04366e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:06.854390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a233-ffe6-40f9-914c-656385d9fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:06.855044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a233-ffe6-40f9-914c-656385d9fdea admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:06.855441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a233-ffe6-40f9-914c-656385d9fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:06.855714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a233-ffe6-40f9-914c-656385d9fdea admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:06.856517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a233-ffe6-40f9-914c-656385d9fdea admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:06.856820 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a233-ffe6-40f9-914c-656385d9fdea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:06.858409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a233-ffe6-40f9-914c-656385d9fdea admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:06.863849 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 592/1187] 10.222.0.58 () {56 vars in 1138 bytes} [Fri Aug 27 03:20:06 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:06.873010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:06.883140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0482-4b25-4c9d-8ecc-6a26c59518a3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:06.889211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02663df-a208-4298-95a8-2c4e9ebcde54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:06.889858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02663df-a208-4298-95a8-2c4e9ebcde54 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:06.890139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02663df-a208-4298-95a8-2c4e9ebcde54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:06.890415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02663df-a208-4298-95a8-2c4e9ebcde54 admin admin] PATH_INFO: `/v3/services` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:06.891123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02663df-a208-4298-95a8-2c4e9ebcde54 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:06.891463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02663df-a208-4298-95a8-2c4e9ebcde54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:06.893041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02663df-a208-4298-95a8-2c4e9ebcde54 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:06.897659 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 596/1188] 10.222.0.58 () {56 vars in 1138 bytes} [Fri Aug 27 03:20:06 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:09.008486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f656f2e-9c54-4d9f-8280-709bfee85cd8 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:09.009093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f656f2e-9c54-4d9f-8280-709bfee85cd8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:09.009093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f656f2e-9c54-4d9f-8280-709bfee85cd8 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:09.010800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 593/1189] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:20:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:20:09.021446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04036-5fbc-4e7f-aefd-9137b5f83270 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:09.022174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04036-5fbc-4e7f-aefd-9137b5f83270 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:09.022351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04036-5fbc-4e7f-aefd-9137b5f83270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:09.045478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ecc04036-5fbc-4e7f-aefd-9137b5f83270 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:20:09.046695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ecc04036-5fbc-4e7f-aefd-9137b5f83270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:20:09.056384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 597/1190] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:20:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:20:09.093258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f656f2e-9c54-4d9f-8280-709bfee85cd8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:09.107033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f656f2e-9c54-4d9f-8280-709bfee85cd8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:09.112519 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2d6a4-49ad-4936-8214-fe7f3d5bf577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:09.113156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d6a4-49ad-4936-8214-fe7f3d5bf577 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:09.113432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d6a4-49ad-4936-8214-fe7f3d5bf577 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:09.113699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2d6a4-49ad-4936-8214-fe7f3d5bf577 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:09.114425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2d6a4-49ad-4936-8214-fe7f3d5bf577 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:09.116033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2d6a4-49ad-4936-8214-fe7f3d5bf577 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:09.135237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 594/1191] 10.222.0.58 () {60 vars in 1163 bytes} [Fri Aug 27 03:20:09 2021] POST /identity/v3/services => generated 246 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:20:11.286519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383613c-22d1-4c5c-b056-83eb748e866a None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:11.287426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383613c-22d1-4c5c-b056-83eb748e866a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:11.287426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383613c-22d1-4c5c-b056-83eb748e866a None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:11.290293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 598/1192] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:20:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:20:11.297344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de6b8-5405-44b9-a558-841db6d3215b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:11.297763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de6b8-5405-44b9-a558-841db6d3215b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:11.297876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82de6b8-5405-44b9-a558-841db6d3215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:11.320767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d82de6b8-5405-44b9-a558-841db6d3215b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:20:11.321949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d82de6b8-5405-44b9-a558-841db6d3215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:20:11.340614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 595/1193] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:20:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:20:11.380326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383613c-22d1-4c5c-b056-83eb748e866a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:11.396600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383613c-22d1-4c5c-b056-83eb748e866a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:11.403460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:11.404255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:11.404536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:11.404810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:11.405455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:11.407055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:11.419403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 03:20:11.420585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 599/1194] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:20:11 2021] GET /identity/v3/services/placement => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:11.427799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de6b8-5405-44b9-a558-841db6d3215b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:11.437854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82de6b8-5405-44b9-a558-841db6d3215b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:11.443722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:11.444369 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:11.444646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:11.444913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:11.445627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:11.445930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:11.447562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:11.454294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 596/1195] 10.222.0.58 () {56 vars in 1138 bytes} [Fri Aug 27 03:20:11 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:11.464411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:11.474870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19137d-62a9-4775-9764-88e0c4db273b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:11.480737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904087a-375f-4aae-ae49-8e1e90b8d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:11.481422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904087a-375f-4aae-ae49-8e1e90b8d284 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:11.481705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904087a-375f-4aae-ae49-8e1e90b8d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:11.481974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904087a-375f-4aae-ae49-8e1e90b8d284 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:11.482770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904087a-375f-4aae-ae49-8e1e90b8d284 admin admin] RBAC: Adding query filter params (interface=public, service_id=a0f5f2124a4d429797ea6f098c67dd16, region_id=RegionOne) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:11.483077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904087a-375f-4aae-ae49-8e1e90b8d284 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:11.484797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904087a-375f-4aae-ae49-8e1e90b8d284 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:11.490438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 600/1196] 10.222.0.58 () {56 vars in 1273 bytes} [Fri Aug 27 03:20:11 2021] GET /identity/v3/endpoints?service_id=a0f5f2124a4d429797ea6f098c67dd16&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:11.497706 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:11.514606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b3a8-9fb9-47ff-b8ba-d4ab0a2fae47 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:11.524380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c203f8a-a6c2-4a89-bc75-c997061be6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:11.525399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c203f8a-a6c2-4a89-bc75-c997061be6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:11.525760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c203f8a-a6c2-4a89-bc75-c997061be6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:11.526086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c203f8a-a6c2-4a89-bc75-c997061be6d2 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:11.527282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c203f8a-a6c2-4a89-bc75-c997061be6d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:11.529205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c203f8a-a6c2-4a89-bc75-c997061be6d2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:11.537280 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 597/1197] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:20:11 2021] GET /identity/v3/services => generated 2191 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:20:13.794959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc83e0-3621-4c92-b584-9e7548d6bbd5 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:13.795571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc83e0-3621-4c92-b584-9e7548d6bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:13.795571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc83e0-3621-4c92-b584-9e7548d6bbd5 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:13.797330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 601/1198] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:20:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:20:13.804496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970407-d46d-4aa9-b66e-f16a360dcb95 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:13.805189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970407-d46d-4aa9-b66e-f16a360dcb95 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:13.805336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49970407-d46d-4aa9-b66e-f16a360dcb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:13.825541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-49970407-d46d-4aa9-b66e-f16a360dcb95 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:20:13.826725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-49970407-d46d-4aa9-b66e-f16a360dcb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:20:13.835531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 598/1199] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:20:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:20:13.871595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc83e0-3621-4c92-b584-9e7548d6bbd5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:13.887001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc83e0-3621-4c92-b584-9e7548d6bbd5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:13.893000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:13.893777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:13.894052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:13.894322 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:13.894968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:13.896589 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:13.907784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING keystone.server.flask.application [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 03:20:13.908891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 602/1200] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Aug 27 03:20:13 2021] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 03:20:13.915566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49970407-d46d-4aa9-b66e-f16a360dcb95 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:13.925032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49970407-d46d-4aa9-b66e-f16a360dcb95 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:13.930867 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf544-89f6-4b4d-ae99-a12d379d4675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:13.931836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf544-89f6-4b4d-ae99-a12d379d4675 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:13.932143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf544-89f6-4b4d-ae99-a12d379d4675 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:13.932410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf544-89f6-4b4d-ae99-a12d379d4675 admin admin] PATH_INFO: `/v3/services` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:13.933175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf544-89f6-4b4d-ae99-a12d379d4675 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:20:13.933641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf544-89f6-4b4d-ae99-a12d379d4675 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:13.935263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf544-89f6-4b4d-ae99-a12d379d4675 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:13.941227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 599/1201] 10.222.0.58 () {56 vars in 1138 bytes} [Fri Aug 27 03:20:13 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:20:13.951510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:20:13.968588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3cf2a-ba83-47d9-9e64-51b8b421d952 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:20:13.976525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386810-7eaa-4630-80c6-bc42860f6b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:20:13.977517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386810-7eaa-4630-80c6-bc42860f6b63 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:20:13.977946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386810-7eaa-4630-80c6-bc42860f6b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:20:13.978378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386810-7eaa-4630-80c6-bc42860f6b63 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:20:13.979583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386810-7eaa-4630-80c6-bc42860f6b63 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:20:13.981576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386810-7eaa-4630-80c6-bc42860f6b63 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:20:14.017691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 603/1202] 10.222.0.58 () {60 vars in 1166 bytes} [Fri Aug 27 03:20:13 2021] POST /identity/v3/endpoints => generated 331 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:21:18.245110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04452586-8c9c-4bd7-8887-f1576bfe3a70 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:18.245110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04452586-8c9c-4bd7-8887-f1576bfe3a70 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:18.245612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04452586-8c9c-4bd7-8887-f1576bfe3a70 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:18.253247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66b41-0b86-4bc7-bf31-6da59886257a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:18.254516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66b41-0b86-4bc7-bf31-6da59886257a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:18.255336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66b41-0b86-4bc7-bf31-6da59886257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:18.258127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 600/1203] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:18 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:18.360851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-25f66b41-0b86-4bc7-bf31-6da59886257a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:18.362066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-25f66b41-0b86-4bc7-bf31-6da59886257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:18.517732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 604/1204] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:21:18.541374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04452586-8c9c-4bd7-8887-f1576bfe3a70 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:18.543180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-04452586-8c9c-4bd7-8887-f1576bfe3a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:18.671632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04452586-8c9c-4bd7-8887-f1576bfe3a70 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:18.771171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e09152-90d6-45b0-a257-9e33a4f08ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:18.771780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e09152-90d6-45b0-a257-9e33a4f08ecf admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:18.772064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e09152-90d6-45b0-a257-9e33a4f08ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:18.772312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e09152-90d6-45b0-a257-9e33a4f08ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:18.773075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e09152-90d6-45b0-a257-9e33a4f08ecf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:18.775615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e09152-90d6-45b0-a257-9e33a4f08ecf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:18.798599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 601/1205] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:21:18 2021] GET /identity/v3/projects => generated 2553 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:21:20.979602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f9641-9df1-4857-b71e-b9ff2168ab40 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:20.980170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f9641-9df1-4857-b71e-b9ff2168ab40 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:20.980170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f9641-9df1-4857-b71e-b9ff2168ab40 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:20.981926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 605/1206] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:20.988058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab177c5-2063-42b8-8023-0df22f57fbf9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:20.988475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab177c5-2063-42b8-8023-0df22f57fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:20.988585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab177c5-2063-42b8-8023-0df22f57fbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:21.059088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7ab177c5-2063-42b8-8023-0df22f57fbf9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:21.060303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7ab177c5-2063-42b8-8023-0df22f57fbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:21.157488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 602/1207] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:21.210377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ceb90-2fed-4428-9820-a3075d31c621 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:21.210769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ceb90-2fed-4428-9820-a3075d31c621 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:21.211110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ceb90-2fed-4428-9820-a3075d31c621 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:21.213245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 606/1208] 10.222.0.58 () {54 vars in 964 bytes} [Fri Aug 27 03:21:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:21.220225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a77d4-f815-4eda-9b5a-f1c07a5ce2a1 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:21.220507 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a77d4-f815-4eda-9b5a-f1c07a5ce2a1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:21.220781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a77d4-f815-4eda-9b5a-f1c07a5ce2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:21.298491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-e76a77d4-f815-4eda-9b5a-f1c07a5ce2a1 None None] MFA Rules not processed for user `3357ca71ec4443f8a9fba9b7ac4cfdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:21.299651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e76a77d4-f815-4eda-9b5a-f1c07a5ce2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:21.380298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 603/1209] 10.222.0.58 () {58 vars in 1062 bytes} [Fri Aug 27 03:21:21 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:21.389816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ceb90-2fed-4428-9820-a3075d31c621 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:21.391482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-562ceb90-2fed-4428-9820-a3075d31c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:21.511816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ceb90-2fed-4428-9820-a3075d31c621 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:21.593901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d942e38-5851-4db1-9ed9-0a1daf208f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:21.594558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d942e38-5851-4db1-9ed9-0a1daf208f4d service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:21.594837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d942e38-5851-4db1-9ed9-0a1daf208f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:21.595107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d942e38-5851-4db1-9ed9-0a1daf208f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:21.596830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6d942e38-5851-4db1-9ed9-0a1daf208f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:21.713639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d942e38-5851-4db1-9ed9-0a1daf208f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:21.715658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d942e38-5851-4db1-9ed9-0a1daf208f4d service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:21.737488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 607/1210] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:24.170441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59dbe4-d240-4adf-9155-e4cc5cc505e2 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:24.170985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59dbe4-d240-4adf-9155-e4cc5cc505e2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:24.170985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59dbe4-d240-4adf-9155-e4cc5cc505e2 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:24.173834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 604/1211] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:24.183311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9134e-f977-4871-ba83-cc48ae6e8f6d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:24.183783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9134e-f977-4871-ba83-cc48ae6e8f6d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:24.183873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9134e-f977-4871-ba83-cc48ae6e8f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:24.260819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-baa9134e-f977-4871-ba83-cc48ae6e8f6d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:24.262059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-baa9134e-f977-4871-ba83-cc48ae6e8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:24.364210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 608/1212] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:24.415266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec85ed-82e7-41ff-a234-d558153d76dc None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:24.415557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec85ed-82e7-41ff-a234-d558153d76dc None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:24.415882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec85ed-82e7-41ff-a234-d558153d76dc None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:24.417704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 605/1213] 10.222.0.58 () {54 vars in 964 bytes} [Fri Aug 27 03:21:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:21:24.426476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286affd-1d69-44df-8fba-378e326668eb None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:24.426757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286affd-1d69-44df-8fba-378e326668eb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:24.427027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286affd-1d69-44df-8fba-378e326668eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:24.506547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e286affd-1d69-44df-8fba-378e326668eb None None] MFA Rules not processed for user `3357ca71ec4443f8a9fba9b7ac4cfdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:24.508385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e286affd-1d69-44df-8fba-378e326668eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:24.609682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 609/1214] 10.222.0.58 () {58 vars in 1062 bytes} [Fri Aug 27 03:21:24 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:21:24.625584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec85ed-82e7-41ff-a234-d558153d76dc None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:24.627890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1fec85ed-82e7-41ff-a234-d558153d76dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:24.738557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec85ed-82e7-41ff-a234-d558153d76dc None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:24.812005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32178bfd-dca1-42eb-bc14-4bd15d736262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:24.812649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178bfd-dca1-42eb-bc14-4bd15d736262 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:24.812930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178bfd-dca1-42eb-bc14-4bd15d736262 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:24.813201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178bfd-dca1-42eb-bc14-4bd15d736262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:24.814812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-32178bfd-dca1-42eb-bc14-4bd15d736262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:24.948993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32178bfd-dca1-42eb-bc14-4bd15d736262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:24.950547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32178bfd-dca1-42eb-bc14-4bd15d736262 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:24.969355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 606/1215] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:27.689922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46558be-8f85-493a-a2a8-456b51894b4f None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:27.690474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46558be-8f85-493a-a2a8-456b51894b4f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:27.690474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46558be-8f85-493a-a2a8-456b51894b4f None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:27.692329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 610/1216] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:27.699562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:27.700308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:27.700436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:27.776543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:27.777747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:27.877580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 607/1217] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:27.918197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46558be-8f85-493a-a2a8-456b51894b4f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:27.919755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c46558be-8f85-493a-a2a8-456b51894b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:28.053542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46558be-8f85-493a-a2a8-456b51894b4f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:28.153033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fffef7-9f96-40dc-ae5b-b44c9fbde072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:28.153904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fffef7-9f96-40dc-ae5b-b44c9fbde072 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:28.154166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fffef7-9f96-40dc-ae5b-b44c9fbde072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:28.154430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fffef7-9f96-40dc-ae5b-b44c9fbde072 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:28.164438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fffef7-9f96-40dc-ae5b-b44c9fbde072 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:28.166686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fffef7-9f96-40dc-ae5b-b44c9fbde072 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:28.168418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 611/1218] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:21:27 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:21:28.185222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:28.186435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:28.280346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a28fe-fbba-458e-86ab-6be93a5657e9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:28.361129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d98ac-7323-43b3-93ab-941bfd218ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:28.361697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d98ac-7323-43b3-93ab-941bfd218ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:28.361971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d98ac-7323-43b3-93ab-941bfd218ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:28.362235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d98ac-7323-43b3-93ab-941bfd218ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:28.363907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f66d98ac-7323-43b3-93ab-941bfd218ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:28.484119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d98ac-7323-43b3-93ab-941bfd218ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:28.485572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d98ac-7323-43b3-93ab-941bfd218ef4 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:28.504121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 608/1219] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:31.194667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8d10-81ad-426f-952b-9e76f4598be8 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:31.195293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8d10-81ad-426f-952b-9e76f4598be8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:31.195293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8d10-81ad-426f-952b-9e76f4598be8 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:31.197252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 612/1220] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:31.204361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:31.205073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:31.205217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:31.293712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:31.294910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:31.399663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 609/1221] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:31.439925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8d10-81ad-426f-952b-9e76f4598be8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:31.441441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-019d8d10-81ad-426f-952b-9e76f4598be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:31.602038 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8d10-81ad-426f-952b-9e76f4598be8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:31.710104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65e2f1-faa3-4dc4-b0ee-12adb45218ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:31.710968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65e2f1-faa3-4dc4-b0ee-12adb45218ff admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:31.711252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65e2f1-faa3-4dc4-b0ee-12adb45218ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:31.711570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65e2f1-faa3-4dc4-b0ee-12adb45218ff admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:31.722749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65e2f1-faa3-4dc4-b0ee-12adb45218ff admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:31.725000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65e2f1-faa3-4dc4-b0ee-12adb45218ff admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:31.727453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 613/1222] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:21:31 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:21:31.740438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:31.741657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:31.858412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5ba49-6809-4424-a209-817879e3c6d9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:31.933622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab4895-e396-4131-b0d2-c86e13bf1b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:31.934266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4895-e396-4131-b0d2-c86e13bf1b4f service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:31.934544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4895-e396-4131-b0d2-c86e13bf1b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:31.934811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4895-e396-4131-b0d2-c86e13bf1b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:31.936474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6cab4895-e396-4131-b0d2-c86e13bf1b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:32.044448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab4895-e396-4131-b0d2-c86e13bf1b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:32.045896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab4895-e396-4131-b0d2-c86e13bf1b4f service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:32.065614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 610/1223] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:34.909410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971866c5-b492-4c8e-b8b9-4f8c244a27c3 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:34.910012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971866c5-b492-4c8e-b8b9-4f8c244a27c3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:34.910012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971866c5-b492-4c8e-b8b9-4f8c244a27c3 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:34.911807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 614/1224] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:34.918278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea25f24-eec8-4b96-b196-24b965474049 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:34.918747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea25f24-eec8-4b96-b196-24b965474049 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:34.918844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea25f24-eec8-4b96-b196-24b965474049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:34.984689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8ea25f24-eec8-4b96-b196-24b965474049 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:34.985907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8ea25f24-eec8-4b96-b196-24b965474049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:35.093798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 611/1225] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:35.131150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971866c5-b492-4c8e-b8b9-4f8c244a27c3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:35.132779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-971866c5-b492-4c8e-b8b9-4f8c244a27c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:35.249635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971866c5-b492-4c8e-b8b9-4f8c244a27c3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:35.326903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0666d-c9eb-4283-87bc-920da3e4551e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:35.327591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0666d-c9eb-4283-87bc-920da3e4551e service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:35.327870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0666d-c9eb-4283-87bc-920da3e4551e service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:35.328144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0666d-c9eb-4283-87bc-920da3e4551e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:35.329765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b9e0666d-c9eb-4283-87bc-920da3e4551e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:35.447606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0666d-c9eb-4283-87bc-920da3e4551e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:35.449058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0666d-c9eb-4283-87bc-920da3e4551e service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:35.468622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 615/1226] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:37.642457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95211b8-4886-429f-93a9-94021c386c2c None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:37.642996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95211b8-4886-429f-93a9-94021c386c2c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:37.642996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95211b8-4886-429f-93a9-94021c386c2c None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:37.644730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 612/1227] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:37.650759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60dd76-0785-4e10-8e87-3d0e3a310656 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:37.651205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60dd76-0785-4e10-8e87-3d0e3a310656 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:37.651318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60dd76-0785-4e10-8e87-3d0e3a310656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:37.718798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-fa60dd76-0785-4e10-8e87-3d0e3a310656 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:37.719964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fa60dd76-0785-4e10-8e87-3d0e3a310656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:37.817748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 616/1228] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:37.854288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95211b8-4886-429f-93a9-94021c386c2c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:37.855856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a95211b8-4886-429f-93a9-94021c386c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:37.962636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95211b8-4886-429f-93a9-94021c386c2c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:38.037904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd39e01-6cbe-4ee2-8a9c-41a66a4f3e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:38.038552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd39e01-6cbe-4ee2-8a9c-41a66a4f3e7d service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:38.038833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd39e01-6cbe-4ee2-8a9c-41a66a4f3e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:38.039098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd39e01-6cbe-4ee2-8a9c-41a66a4f3e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:38.040845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-edd39e01-6cbe-4ee2-8a9c-41a66a4f3e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:38.149150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd39e01-6cbe-4ee2-8a9c-41a66a4f3e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:38.150607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd39e01-6cbe-4ee2-8a9c-41a66a4f3e7d service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:38.169299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 613/1229] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:40.379224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd5d-1a39-439b-88b0-366046c03dc4 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:40.379843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd5d-1a39-439b-88b0-366046c03dc4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:40.379843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5dd5d-1a39-439b-88b0-366046c03dc4 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:40.381884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 617/1230] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:40.388785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:40.389359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:40.389359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:40.461647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:40.463222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:40.574886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 614/1231] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:40.609385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd5d-1a39-439b-88b0-366046c03dc4 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:40.610988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-34a5dd5d-1a39-439b-88b0-366046c03dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:40.756459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5dd5d-1a39-439b-88b0-366046c03dc4 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:40.865592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5e0b3-54f0-488f-8901-a7bbff24029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:40.866380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e0b3-54f0-488f-8901-a7bbff24029c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:40.866656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e0b3-54f0-488f-8901-a7bbff24029c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:40.866928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5e0b3-54f0-488f-8901-a7bbff24029c admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:40.880389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5e0b3-54f0-488f-8901-a7bbff24029c admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:40.882494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5e0b3-54f0-488f-8901-a7bbff24029c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:40.884813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 618/1232] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:21:40 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:21:40.897471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:40.898698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:41.004717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d2e55-fed3-4b19-b08b-8973db8c56cb None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:41.086293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60728e17-426e-4312-903c-86ec417c19e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:41.087031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728e17-426e-4312-903c-86ec417c19e1 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:41.088077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728e17-426e-4312-903c-86ec417c19e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:41.088077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728e17-426e-4312-903c-86ec417c19e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:41.089365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-60728e17-426e-4312-903c-86ec417c19e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:41.226331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60728e17-426e-4312-903c-86ec417c19e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:41.228247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60728e17-426e-4312-903c-86ec417c19e1 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:41.253391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 615/1233] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:43.798969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89bd73-b8c0-4e75-819f-ee89f30e1ec2 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:43.799555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89bd73-b8c0-4e75-819f-ee89f30e1ec2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:43.799555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89bd73-b8c0-4e75-819f-ee89f30e1ec2 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:43.802353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 619/1234] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:43.810273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858d5a-5a30-4a9a-97c8-886904e6579e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:43.810734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858d5a-5a30-4a9a-97c8-886904e6579e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:43.810826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a858d5a-5a30-4a9a-97c8-886904e6579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:43.878478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3a858d5a-5a30-4a9a-97c8-886904e6579e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:43.879727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3a858d5a-5a30-4a9a-97c8-886904e6579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:43.982347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 616/1235] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:21:44.020994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89bd73-b8c0-4e75-819f-ee89f30e1ec2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:44.023395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1c89bd73-b8c0-4e75-819f-ee89f30e1ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:44.153895 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89bd73-b8c0-4e75-819f-ee89f30e1ec2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:44.241765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae25dc1-de34-4f1c-897b-908b9cc9793a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:44.242640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25dc1-de34-4f1c-897b-908b9cc9793a service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:44.242797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25dc1-de34-4f1c-897b-908b9cc9793a service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:44.243033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25dc1-de34-4f1c-897b-908b9cc9793a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:44.244810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2ae25dc1-de34-4f1c-897b-908b9cc9793a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:44.364165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae25dc1-de34-4f1c-897b-908b9cc9793a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:44.365608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae25dc1-de34-4f1c-897b-908b9cc9793a service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:44.392434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 620/1236] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:46.583397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3cb58-f1fe-4069-b146-b926f44cbf37 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:46.584273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3cb58-f1fe-4069-b146-b926f44cbf37 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:46.584273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3cb58-f1fe-4069-b146-b926f44cbf37 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:46.586959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 617/1237] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:46.595729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c08d9-4970-4318-8993-fd3565ef613e None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:46.596540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c08d9-4970-4318-8993-fd3565ef613e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:46.596826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c08d9-4970-4318-8993-fd3565ef613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:46.670941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-366c08d9-4970-4318-8993-fd3565ef613e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:46.672792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-366c08d9-4970-4318-8993-fd3565ef613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:46.770400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 621/1238] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:21:46.815231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3cb58-f1fe-4069-b146-b926f44cbf37 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:46.817787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d6e3cb58-f1fe-4069-b146-b926f44cbf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:46.949666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3cb58-f1fe-4069-b146-b926f44cbf37 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:47.037072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180cf0c-9bdd-4367-8fe4-af6b6fdb5da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:47.037728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180cf0c-9bdd-4367-8fe4-af6b6fdb5da7 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:47.038015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180cf0c-9bdd-4367-8fe4-af6b6fdb5da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:47.038294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180cf0c-9bdd-4367-8fe4-af6b6fdb5da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:47.040295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e180cf0c-9bdd-4367-8fe4-af6b6fdb5da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:47.156632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180cf0c-9bdd-4367-8fe4-af6b6fdb5da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:47.158082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180cf0c-9bdd-4367-8fe4-af6b6fdb5da7 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:47.176894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 618/1239] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:49.834341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3610ad-b3e7-4f54-9d33-3834b5bd62f6 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:49.835256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3610ad-b3e7-4f54-9d33-3834b5bd62f6 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:49.835256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3610ad-b3e7-4f54-9d33-3834b5bd62f6 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:49.837719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 622/1240] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:49.843899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4dc1-b843-4a83-863b-0ed922183c92 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:49.844377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4dc1-b843-4a83-863b-0ed922183c92 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:49.844488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4dc1-b843-4a83-863b-0ed922183c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:49.924876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0d9d4dc1-b843-4a83-863b-0ed922183c92 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:49.926076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0d9d4dc1-b843-4a83-863b-0ed922183c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:50.038717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 619/1241] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:50.078538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3610ad-b3e7-4f54-9d33-3834b5bd62f6 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:50.080749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ca3610ad-b3e7-4f54-9d33-3834b5bd62f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:50.176512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3610ad-b3e7-4f54-9d33-3834b5bd62f6 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:50.180230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf60788-5ea9-4122-b711-62c0319f3c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:50.181188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf60788-5ea9-4122-b711-62c0319f3c22 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:50.181470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf60788-5ea9-4122-b711-62c0319f3c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:50.181742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf60788-5ea9-4122-b711-62c0319f3c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:50.190583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf60788-5ea9-4122-b711-62c0319f3c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:50.192046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf60788-5ea9-4122-b711-62c0319f3c22 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:50.201237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 623/1242] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:21:54.384201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a12e6-c5eb-4a02-89d8-bcbbcebeafab None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:54.384718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a12e6-c5eb-4a02-89d8-bcbbcebeafab None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:54.384718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a12e6-c5eb-4a02-89d8-bcbbcebeafab None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:54.386598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 620/1243] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:54.392677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f1bd-9892-4f0c-bd62-8827fa932dff None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:54.393544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f1bd-9892-4f0c-bd62-8827fa932dff None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:54.393792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f1bd-9892-4f0c-bd62-8827fa932dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:54.412174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-40c4f1bd-9892-4f0c-bd62-8827fa932dff None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:54.413412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-40c4f1bd-9892-4f0c-bd62-8827fa932dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:54.422817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 624/1244] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:54.463198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a12e6-c5eb-4a02-89d8-bcbbcebeafab None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:54.465164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e66a12e6-c5eb-4a02-89d8-bcbbcebeafab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:54.479010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a12e6-c5eb-4a02-89d8-bcbbcebeafab None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:54.482919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78577145-d5ac-470f-9ca4-00653afda062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:54.483590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577145-d5ac-470f-9ca4-00653afda062 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:54.483857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577145-d5ac-470f-9ca4-00653afda062 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:54.484132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577145-d5ac-470f-9ca4-00653afda062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:54.493533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78577145-d5ac-470f-9ca4-00653afda062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:54.494937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78577145-d5ac-470f-9ca4-00653afda062 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:54.504660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 621/1245] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:21:57.349486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab12546-a0da-4f78-b76e-331471fa9126 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:57.350073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab12546-a0da-4f78-b76e-331471fa9126 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:57.350073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab12546-a0da-4f78-b76e-331471fa9126 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:57.352055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 625/1246] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:21:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:21:57.358408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6113-7b6f-42bf-91e4-bc4f9c6b3ed2 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:57.358875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6113-7b6f-42bf-91e4-bc4f9c6b3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:57.359067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6113-7b6f-42bf-91e4-bc4f9c6b3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:57.377522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-deeb6113-7b6f-42bf-91e4-bc4f9c6b3ed2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:21:57.378700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-deeb6113-7b6f-42bf-91e4-bc4f9c6b3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:21:57.387492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 622/1247] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:21:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:21:57.425544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab12546-a0da-4f78-b76e-331471fa9126 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:21:57.437789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab12546-a0da-4f78-b76e-331471fa9126 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:21:57.441512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc315bec-c5eb-4010-8ecc-1f7f34000a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:21:57.442157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315bec-c5eb-4010-8ecc-1f7f34000a04 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:21:57.442442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315bec-c5eb-4010-8ecc-1f7f34000a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:21:57.442717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315bec-c5eb-4010-8ecc-1f7f34000a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:21:57.453053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc315bec-c5eb-4010-8ecc-1f7f34000a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:21:57.454495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc315bec-c5eb-4010-8ecc-1f7f34000a04 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:21:57.464996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 626/1248] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:21:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:01.654521 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da228-4767-4078-a186-80729a90beda None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:01.655118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da228-4767-4078-a186-80729a90beda None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:01.655118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965da228-4767-4078-a186-80729a90beda None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:01.657277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 623/1249] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:01.663435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897774c3-30df-478d-b4e5-5e82b8d8a6eb None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:01.663923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897774c3-30df-478d-b4e5-5e82b8d8a6eb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:01.664065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897774c3-30df-478d-b4e5-5e82b8d8a6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:01.683668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-897774c3-30df-478d-b4e5-5e82b8d8a6eb None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:01.684900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-897774c3-30df-478d-b4e5-5e82b8d8a6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:01.694006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 627/1250] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:01.734325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965da228-4767-4078-a186-80729a90beda None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:01.745560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965da228-4767-4078-a186-80729a90beda None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:01.749134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40606436-bcbe-4097-ab1c-94393d5436b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:01.749691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606436-bcbe-4097-ab1c-94393d5436b0 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:01.749969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606436-bcbe-4097-ab1c-94393d5436b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:01.750240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606436-bcbe-4097-ab1c-94393d5436b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:01.759734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40606436-bcbe-4097-ab1c-94393d5436b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:01.761176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40606436-bcbe-4097-ab1c-94393d5436b0 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:01.770718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 624/1251] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:06.793275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106552f9-20ad-4faa-9008-0f39327cd903 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:06.793844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106552f9-20ad-4faa-9008-0f39327cd903 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:06.793844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106552f9-20ad-4faa-9008-0f39327cd903 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:06.797173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 628/1252] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:22:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:06.816965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fc12a-9976-4077-88da-b86c4ac9178f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:06.817501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fc12a-9976-4077-88da-b86c4ac9178f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:06.817501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fc12a-9976-4077-88da-b86c4ac9178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:06.893833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a66fc12a-9976-4077-88da-b86c4ac9178f None None] MFA Rules not processed for user `58838486fa5f49c4bca67ad01713fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:06.895388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a66fc12a-9976-4077-88da-b86c4ac9178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:06.978289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 625/1253] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:22:06 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:11.180378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654000-a13c-4b49-b376-79f18e62ea60 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:11.180933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654000-a13c-4b49-b376-79f18e62ea60 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:11.181072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27654000-a13c-4b49-b376-79f18e62ea60 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:11.183569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 629/1254] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:22:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:11.188822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720a80-afe7-4a43-8f38-02f2db188c50 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:11.189223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720a80-afe7-4a43-8f38-02f2db188c50 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:11.189583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720a80-afe7-4a43-8f38-02f2db188c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:11.208879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d8720a80-afe7-4a43-8f38-02f2db188c50 None None] MFA Rules not processed for user `58838486fa5f49c4bca67ad01713fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:11.210218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d8720a80-afe7-4a43-8f38-02f2db188c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:11.219503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 626/1255] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:22:11 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:12.718613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318edd-6d2c-457a-bb58-87483f5864c8 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:12.719165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318edd-6d2c-457a-bb58-87483f5864c8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:12.719165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318edd-6d2c-457a-bb58-87483f5864c8 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:12.720978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 630/1256] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:22:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:12.726619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587e62a-6134-4218-8331-9e44dfe8f1c6 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:12.727106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587e62a-6134-4218-8331-9e44dfe8f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:12.727199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587e62a-6134-4218-8331-9e44dfe8f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:12.747152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3587e62a-6134-4218-8331-9e44dfe8f1c6 None None] MFA Rules not processed for user `58838486fa5f49c4bca67ad01713fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:12.748415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3587e62a-6134-4218-8331-9e44dfe8f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:12.759149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 627/1257] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:22:12 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:16.620810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544271bf-3182-4a84-8a93-e00f69aefca9 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:16.621358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544271bf-3182-4a84-8a93-e00f69aefca9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:16.621358 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544271bf-3182-4a84-8a93-e00f69aefca9 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:16.623013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 631/1258] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:16.629084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e46c-60da-4e3a-831e-d6458eb10461 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:16.629536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e46c-60da-4e3a-831e-d6458eb10461 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:16.629634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e46c-60da-4e3a-831e-d6458eb10461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:16.648794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-6966e46c-60da-4e3a-831e-d6458eb10461 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:16.650039 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6966e46c-60da-4e3a-831e-d6458eb10461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:16.659109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 628/1259] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:16.711090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d0bb-f531-4cad-bc66-41c86e406775 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:16.711393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d0bb-f531-4cad-bc66-41c86e406775 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:16.711696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7d0bb-f531-4cad-bc66-41c86e406775 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:16.713443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 632/1260] 10.222.0.58 () {54 vars in 961 bytes} [Fri Aug 27 03:22:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:16.719281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f5c8-0843-47b9-b5a7-fba9dc857971 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:16.719611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f5c8-0843-47b9-b5a7-fba9dc857971 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:16.720040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f5c8-0843-47b9-b5a7-fba9dc857971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:16.771999 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-fe60f5c8-0843-47b9-b5a7-fba9dc857971 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:16.773463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-fe60f5c8-0843-47b9-b5a7-fba9dc857971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:16.857527 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 629/1261] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Aug 27 03:22:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:16.867333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7d0bb-f531-4cad-bc66-41c86e406775 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:16.883494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7d0bb-f531-4cad-bc66-41c86e406775 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:16.890041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8b176-7be2-4738-bed4-a2bda54433bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:16.890685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8b176-7be2-4738-bed4-a2bda54433bd service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:16.890968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8b176-7be2-4738-bed4-a2bda54433bd service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:16.891244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8b176-7be2-4738-bed4-a2bda54433bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:16.900428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8b176-7be2-4738-bed4-a2bda54433bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:16.902512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8b176-7be2-4738-bed4-a2bda54433bd service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:16.913991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 633/1262] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:19.316840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e867eb-c05f-4a10-8700-ab5aa48cf260 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:19.317712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e867eb-c05f-4a10-8700-ab5aa48cf260 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:19.318138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e867eb-c05f-4a10-8700-ab5aa48cf260 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:19.325628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 630/1263] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:19 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:19.327215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d04c4c-3fa7-4de8-8f30-d8a781849850 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:19.327710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d04c4c-3fa7-4de8-8f30-d8a781849850 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:19.327970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d04c4c-3fa7-4de8-8f30-d8a781849850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:19.348157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-03d04c4c-3fa7-4de8-8f30-d8a781849850 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:19.349654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-03d04c4c-3fa7-4de8-8f30-d8a781849850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:19.384424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 634/1264] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:22:19.413209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e867eb-c05f-4a10-8700-ab5aa48cf260 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:19.428245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e867eb-c05f-4a10-8700-ab5aa48cf260 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:19.434211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916da464-6166-453b-b477-935adda49ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:19.434882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da464-6166-453b-b477-935adda49ab9 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:19.435171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da464-6166-453b-b477-935adda49ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:19.435479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da464-6166-453b-b477-935adda49ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:19.443660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916da464-6166-453b-b477-935adda49ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:19.445555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916da464-6166-453b-b477-935adda49ab9 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:19.456188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 631/1265] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:21.917555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa1ceb-5b8f-456a-b879-e95903f2787c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:21.918132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa1ceb-5b8f-456a-b879-e95903f2787c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:21.918625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa1ceb-5b8f-456a-b879-e95903f2787c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:21.921734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 635/1266] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:21.928446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b611ff-f70c-4476-9b0f-89792bb4d201 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:21.929165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b611ff-f70c-4476-9b0f-89792bb4d201 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:21.929165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b611ff-f70c-4476-9b0f-89792bb4d201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:21.948503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-00b611ff-f70c-4476-9b0f-89792bb4d201 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:21.949722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-00b611ff-f70c-4476-9b0f-89792bb4d201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:21.957945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 632/1267] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:22:22.005598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0d6a4-c2fb-4b4c-90e0-38f46579b98c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:22.005883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0d6a4-c2fb-4b4c-90e0-38f46579b98c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:22.006162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0d6a4-c2fb-4b4c-90e0-38f46579b98c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:22.008277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 636/1268] 10.222.0.58 () {54 vars in 961 bytes} [Fri Aug 27 03:22:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:22.014316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ece4ee-db4b-4b3d-9a75-e6ccb9a817a7 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:22.014633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ece4ee-db4b-4b3d-9a75-e6ccb9a817a7 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:22.014911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ece4ee-db4b-4b3d-9a75-e6ccb9a817a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:22.035305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-e1ece4ee-db4b-4b3d-9a75-e6ccb9a817a7 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:22.036542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e1ece4ee-db4b-4b3d-9a75-e6ccb9a817a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:22.048429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 633/1269] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Aug 27 03:22:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:22.056845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0d6a4-c2fb-4b4c-90e0-38f46579b98c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:22.072460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0d6a4-c2fb-4b4c-90e0-38f46579b98c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:22.078618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecce88d-1460-4633-ac32-1d58a1ae5e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:22.079260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecce88d-1460-4633-ac32-1d58a1ae5e42 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:22.079570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecce88d-1460-4633-ac32-1d58a1ae5e42 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:22.079846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecce88d-1460-4633-ac32-1d58a1ae5e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:22.088336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecce88d-1460-4633-ac32-1d58a1ae5e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:22.090406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecce88d-1460-4633-ac32-1d58a1ae5e42 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:22.100652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 637/1270] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:24.430253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369c8d-fbe5-46ce-b474-f9daea91bb6e None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.430831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369c8d-fbe5-46ce-b474-f9daea91bb6e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.430831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17369c8d-fbe5-46ce-b474-f9daea91bb6e None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.432597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 634/1271] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:24.433916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cbe71-9f2e-475d-b32b-f7b0c4fe54ce None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.434710 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cbe71-9f2e-475d-b32b-f7b0c4fe54ce None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.435197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cbe71-9f2e-475d-b32b-f7b0c4fe54ce None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.438440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94466882-f249-4f62-ab45-f4f0e89810c1 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.438689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94466882-f249-4f62-ab45-f4f0e89810c1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.439129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94466882-f249-4f62-ab45-f4f0e89810c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.439338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 638/1272] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:22:24.443113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb946-2e3b-4574-ad9e-8da912be0688 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.443393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb946-2e3b-4574-ad9e-8da912be0688 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.443693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cb946-2e3b-4574-ad9e-8da912be0688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.458124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-94466882-f249-4f62-ab45-f4f0e89810c1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:24.459438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-94466882-f249-4f62-ab45-f4f0e89810c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:24.464824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-598cb946-2e3b-4574-ad9e-8da912be0688 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:24.466006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-598cb946-2e3b-4574-ad9e-8da912be0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:24.468114 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 635/1273] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:22:24.474293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 639/1274] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:22:24.521860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94466882-f249-4f62-ab45-f4f0e89810c1 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:24.528076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54902da2-3f7c-4633-8c80-a68a580cf1a8 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.528331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54902da2-3f7c-4633-8c80-a68a580cf1a8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.528777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54902da2-3f7c-4633-8c80-a68a580cf1a8 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.530994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 640/1275] 10.222.0.58 () {54 vars in 966 bytes} [Fri Aug 27 03:22:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:22:24.536053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb5e6-fda8-4760-904a-658f1187e9bb None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.536337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb5e6-fda8-4760-904a-658f1187e9bb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.536617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb5e6-fda8-4760-904a-658f1187e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.537068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94466882-f249-4f62-ab45-f4f0e89810c1 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:24.544597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:24.545538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.546017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.546486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.556227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:24.557964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:24.568073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 636/1276] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:24.594634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-172bb5e6-fda8-4760-904a-658f1187e9bb None None] MFA Rules not processed for user `d5d8aa6c0fa94ced8f7b277572b06dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:24.595911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-172bb5e6-fda8-4760-904a-658f1187e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:24.669673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 641/1277] 10.222.0.58 () {58 vars in 1064 bytes} [Fri Aug 27 03:22:24 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:22:24.678673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:24.690608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32756ac-c27a-4829-b221-7ca75f5aa563 service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:24.696458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5b2b1-6620-4cac-a4c6-35529632d181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:24.697518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5b2b1-6620-4cac-a4c6-35529632d181 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:24.698186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5b2b1-6620-4cac-a4c6-35529632d181 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:24.698595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5b2b1-6620-4cac-a4c6-35529632d181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:24.709800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5b2b1-6620-4cac-a4c6-35529632d181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:24.711674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5b2b1-6620-4cac-a4c6-35529632d181 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:24.724070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 637/1278] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:26.867246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e6c0-c8e8-4d7b-a330-53a88780de4d None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:26.867789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e6c0-c8e8-4d7b-a330-53a88780de4d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:26.867882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0e6c0-c8e8-4d7b-a330-53a88780de4d None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:26.869614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 642/1279] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:26.876195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9da4-5311-4a12-966b-b424fbd9fa3e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:26.876983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9da4-5311-4a12-966b-b424fbd9fa3e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:26.877413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9da4-5311-4a12-966b-b424fbd9fa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:26.896610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0f5e9da4-5311-4a12-966b-b424fbd9fa3e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:26.897885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0f5e9da4-5311-4a12-966b-b424fbd9fa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:26.906529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 638/1280] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:22:26.955676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0e6c0-c8e8-4d7b-a330-53a88780de4d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:26.970123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0e6c0-c8e8-4d7b-a330-53a88780de4d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:26.975755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050a3cd-1a73-488c-b79e-09961a303465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:26.976487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050a3cd-1a73-488c-b79e-09961a303465 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:26.976764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050a3cd-1a73-488c-b79e-09961a303465 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:26.977033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050a3cd-1a73-488c-b79e-09961a303465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:26.985057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050a3cd-1a73-488c-b79e-09961a303465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:26.986646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050a3cd-1a73-488c-b79e-09961a303465 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:26.996355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 643/1281] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:29.171541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66c8a-f0f4-4796-af16-b982aceabf8f None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:29.172128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66c8a-f0f4-4796-af16-b982aceabf8f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:29.172128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66c8a-f0f4-4796-af16-b982aceabf8f None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:29.173827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 639/1282] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:29.180375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9260e-a5b1-4d3d-9961-94dae3dbbe22 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:29.181065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9260e-a5b1-4d3d-9961-94dae3dbbe22 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:29.181321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9260e-a5b1-4d3d-9961-94dae3dbbe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:29.200521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-17f9260e-a5b1-4d3d-9961-94dae3dbbe22 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:29.201728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-17f9260e-a5b1-4d3d-9961-94dae3dbbe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:29.210863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 644/1283] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:29.256426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66c8a-f0f4-4796-af16-b982aceabf8f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:29.272403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66c8a-f0f4-4796-af16-b982aceabf8f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:29.277731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf01a7a-2d41-45a0-84c0-f20bd977ef2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:29.278373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01a7a-2d41-45a0-84c0-f20bd977ef2b service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:29.278652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01a7a-2d41-45a0-84c0-f20bd977ef2b service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:29.278924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01a7a-2d41-45a0-84c0-f20bd977ef2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:29.287157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf01a7a-2d41-45a0-84c0-f20bd977ef2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:29.288930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf01a7a-2d41-45a0-84c0-f20bd977ef2b service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:29.298445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 640/1284] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:31.467900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078274a1-00eb-43ca-a63c-b5f45a3e0dfe None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:31.468472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078274a1-00eb-43ca-a63c-b5f45a3e0dfe None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:31.468472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078274a1-00eb-43ca-a63c-b5f45a3e0dfe None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:31.470161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 645/1285] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:31.476556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e394a-bf66-40b7-88c2-5e8f99acffa2 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:31.476948 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e394a-bf66-40b7-88c2-5e8f99acffa2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:31.477131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e394a-bf66-40b7-88c2-5e8f99acffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:31.497346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-9c8e394a-bf66-40b7-88c2-5e8f99acffa2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:31.498561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9c8e394a-bf66-40b7-88c2-5e8f99acffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:31.520302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 641/1286] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:31.552574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078274a1-00eb-43ca-a63c-b5f45a3e0dfe None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:31.568939 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078274a1-00eb-43ca-a63c-b5f45a3e0dfe None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:31.574305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719722b-b8c9-4238-bb38-e83761dff4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:31.574942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719722b-b8c9-4238-bb38-e83761dff4ca service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:31.575237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719722b-b8c9-4238-bb38-e83761dff4ca service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:31.575582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719722b-b8c9-4238-bb38-e83761dff4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:31.585244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719722b-b8c9-4238-bb38-e83761dff4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:31.588294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719722b-b8c9-4238-bb38-e83761dff4ca service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:31.605790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 646/1287] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:33.757859 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f6d6-2de4-4de4-b106-096626f9faa6 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:33.758737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f6d6-2de4-4de4-b106-096626f9faa6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:33.758737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8f6d6-2de4-4de4-b106-096626f9faa6 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:33.760228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 642/1288] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:33.766763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e962-bf09-4e06-bc2c-2fc27c9ce512 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:33.767374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e962-bf09-4e06-bc2c-2fc27c9ce512 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:33.767374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e962-bf09-4e06-bc2c-2fc27c9ce512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:33.787280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-6f47e962-bf09-4e06-bc2c-2fc27c9ce512 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:33.788897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6f47e962-bf09-4e06-bc2c-2fc27c9ce512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:33.799272 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 647/1289] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:33.859800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8f6d6-2de4-4de4-b106-096626f9faa6 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:33.875831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8f6d6-2de4-4de4-b106-096626f9faa6 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:33.881933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65a097-5706-47a3-8962-eb1539d03627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:33.882580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a097-5706-47a3-8962-eb1539d03627 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:33.882896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a097-5706-47a3-8962-eb1539d03627 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:33.883168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a097-5706-47a3-8962-eb1539d03627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:33.891662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65a097-5706-47a3-8962-eb1539d03627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:33.893260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65a097-5706-47a3-8962-eb1539d03627 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:33.904380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 643/1290] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:36.211800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084958-ffd6-40da-b759-58c6df86ff5e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:36.212392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084958-ffd6-40da-b759-58c6df86ff5e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:36.212392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084958-ffd6-40da-b759-58c6df86ff5e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:36.214448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 648/1291] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:36.222261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ce49-80c5-4ea8-85a8-dce599b0bba0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:36.222715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ce49-80c5-4ea8-85a8-dce599b0bba0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:36.222823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ce49-80c5-4ea8-85a8-dce599b0bba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:36.244458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c7e7ce49-80c5-4ea8-85a8-dce599b0bba0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:36.245642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c7e7ce49-80c5-4ea8-85a8-dce599b0bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:36.253713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 644/1292] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:36.309238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084958-ffd6-40da-b759-58c6df86ff5e None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:36.324531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084958-ffd6-40da-b759-58c6df86ff5e None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:36.330906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b432de-4158-4ba7-8308-9fbc4e70a59a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:36.331590 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b432de-4158-4ba7-8308-9fbc4e70a59a service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:36.331872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b432de-4158-4ba7-8308-9fbc4e70a59a service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:36.332148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b432de-4158-4ba7-8308-9fbc4e70a59a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:36.342036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b432de-4158-4ba7-8308-9fbc4e70a59a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:36.343662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b432de-4158-4ba7-8308-9fbc4e70a59a service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:36.353679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 649/1293] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:38.544094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2f0c-ebb3-4b0e-ae20-21b38167cc16 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:38.544671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2f0c-ebb3-4b0e-ae20-21b38167cc16 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:38.544671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a2f0c-ebb3-4b0e-ae20-21b38167cc16 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:38.546516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 645/1294] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:38.552482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6995-44e4-431a-9ac0-995dfab840ae None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:38.552967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6995-44e4-431a-9ac0-995dfab840ae None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:38.553167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6995-44e4-431a-9ac0-995dfab840ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:38.571803 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d1bb6995-44e4-431a-9ac0-995dfab840ae None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:38.573045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d1bb6995-44e4-431a-9ac0-995dfab840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:38.582103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 650/1295] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:38.628903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a2f0c-ebb3-4b0e-ae20-21b38167cc16 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:38.644657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a2f0c-ebb3-4b0e-ae20-21b38167cc16 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:38.650888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dfa57-3d77-40c2-a9f6-9f97aaa55bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:38.651502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dfa57-3d77-40c2-a9f6-9f97aaa55bec service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:38.651780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dfa57-3d77-40c2-a9f6-9f97aaa55bec service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:38.652022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dfa57-3d77-40c2-a9f6-9f97aaa55bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:38.660758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dfa57-3d77-40c2-a9f6-9f97aaa55bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:38.662372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dfa57-3d77-40c2-a9f6-9f97aaa55bec service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:38.672768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 646/1296] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:39.587690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289fcd-8d62-4928-9fd0-afabd0067af2 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:39.588306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289fcd-8d62-4928-9fd0-afabd0067af2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:39.588306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289fcd-8d62-4928-9fd0-afabd0067af2 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:39.589975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 651/1297] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:39.596038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b166a63-186b-4e66-8332-505f34520ecb None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:39.596501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b166a63-186b-4e66-8332-505f34520ecb None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:39.596593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b166a63-186b-4e66-8332-505f34520ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:39.615438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3b166a63-186b-4e66-8332-505f34520ecb None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:39.617440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3b166a63-186b-4e66-8332-505f34520ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:39.625457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 647/1298] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:39.685170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8d17-102f-4034-bafb-d03b4f9a8f89 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:39.685462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8d17-102f-4034-bafb-d03b4f9a8f89 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:39.685734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8d17-102f-4034-bafb-d03b4f9a8f89 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:39.687508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 652/1299] 10.222.0.58 () {54 vars in 966 bytes} [Fri Aug 27 03:22:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:39.693348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4dbd9-383c-4d45-ad85-cfbb945facfa None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:39.693634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4dbd9-383c-4d45-ad85-cfbb945facfa None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:39.694034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4dbd9-383c-4d45-ad85-cfbb945facfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:39.745912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a5f4dbd9-383c-4d45-ad85-cfbb945facfa None None] MFA Rules not processed for user `b43f60d8ae5f4e8cb3ba57f76777ac84`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:39.747122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a5f4dbd9-383c-4d45-ad85-cfbb945facfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:39.808566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 648/1300] 10.222.0.58 () {58 vars in 1064 bytes} [Fri Aug 27 03:22:39 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:39.816442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8d17-102f-4034-bafb-d03b4f9a8f89 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:39.827586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8d17-102f-4034-bafb-d03b4f9a8f89 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:39.831191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519301d7-cfd9-4847-9edc-17ff01f6c063 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:39.831854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519301d7-cfd9-4847-9edc-17ff01f6c063 service glance] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:39.832137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519301d7-cfd9-4847-9edc-17ff01f6c063 service glance] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:39.832407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519301d7-cfd9-4847-9edc-17ff01f6c063 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:39.842211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519301d7-cfd9-4847-9edc-17ff01f6c063 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:39.843609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519301d7-cfd9-4847-9edc-17ff01f6c063 service glance] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:39.854596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 653/1301] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:40.304068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8c1f5-afbe-40c1-8619-130460d04a35 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:40.304360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8c1f5-afbe-40c1-8619-130460d04a35 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:40.304971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8c1f5-afbe-40c1-8619-130460d04a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:40.354310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b1c8c1f5-afbe-40c1-8619-130460d04a35 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:40.355596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b1c8c1f5-afbe-40c1-8619-130460d04a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:40.421646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 649/1302] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:22:40 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:40.467483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6caa6-4dca-47d1-9147-cb4b0dea0a83 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:40.467776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6caa6-4dca-47d1-9147-cb4b0dea0a83 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:40.468054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6caa6-4dca-47d1-9147-cb4b0dea0a83 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:40.469838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 654/1303] 10.222.0.58 () {54 vars in 942 bytes} [Fri Aug 27 03:22:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:40.482167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5340-3dfc-4450-a930-3933a10bb06a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:40.482487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5340-3dfc-4450-a930-3933a10bb06a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:40.482769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5340-3dfc-4450-a930-3933a10bb06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:40.545836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f34b5340-3dfc-4450-a930-3933a10bb06a None None] MFA Rules not processed for user `f9170b262488467fad0bf6aad8d3814a`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:40.547061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f34b5340-3dfc-4450-a930-3933a10bb06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:40.622750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 650/1304] 10.222.0.58 () {58 vars in 1040 bytes} [Fri Aug 27 03:22:40 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:40.632936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6caa6-4dca-47d1-9147-cb4b0dea0a83 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:40.650976 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6caa6-4dca-47d1-9147-cb4b0dea0a83 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:40.656730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ca624-95d7-4874-91fe-04f92d8c7d06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:40.657451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ca624-95d7-4874-91fe-04f92d8c7d06 service swift] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:40.657816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ca624-95d7-4874-91fe-04f92d8c7d06 service swift] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:40.658154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ca624-95d7-4874-91fe-04f92d8c7d06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:40.668263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ca624-95d7-4874-91fe-04f92d8c7d06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:40.669830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ca624-95d7-4874-91fe-04f92d8c7d06 service swift] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:40.679196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 655/1305] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:22:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:22:40.861905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934148-2595-430a-b153-5f0f589ad492 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:40.862166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934148-2595-430a-b153-5f0f589ad492 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:40.862468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934148-2595-430a-b153-5f0f589ad492 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:40.864616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 651/1306] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:40.871296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a568e7-00ff-4bff-b0c0-4f9e6679efb2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:40.872116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a568e7-00ff-4bff-b0c0-4f9e6679efb2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:40.872586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a568e7-00ff-4bff-b0c0-4f9e6679efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:40.892941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-59a568e7-00ff-4bff-b0c0-4f9e6679efb2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:40.894139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-59a568e7-00ff-4bff-b0c0-4f9e6679efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:40.916455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 656/1307] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:40.980267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934148-2595-430a-b153-5f0f589ad492 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:40.998961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934148-2595-430a-b153-5f0f589ad492 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:41.004875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81223adf-b797-4a8d-afe0-0a36a288e699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:41.006426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223adf-b797-4a8d-afe0-0a36a288e699 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:41.006426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223adf-b797-4a8d-afe0-0a36a288e699 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:41.007041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223adf-b797-4a8d-afe0-0a36a288e699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:41.018587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81223adf-b797-4a8d-afe0-0a36a288e699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:41.021109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81223adf-b797-4a8d-afe0-0a36a288e699 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:41.032895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 652/1308] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:43.283878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd1bb-aba8-401b-89a3-0a1cf1f1f42b None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:43.284434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd1bb-aba8-401b-89a3-0a1cf1f1f42b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:43.284434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd1bb-aba8-401b-89a3-0a1cf1f1f42b None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:43.287974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 657/1309] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:43.292098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8d1e-3879-4bbe-a841-09434658c8ba None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:43.292896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8d1e-3879-4bbe-a841-09434658c8ba None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:43.293171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8d1e-3879-4bbe-a841-09434658c8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:43.314555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-eb7a8d1e-3879-4bbe-a841-09434658c8ba None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:43.316108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-eb7a8d1e-3879-4bbe-a841-09434658c8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:43.325266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 653/1310] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:22:43.372008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dd1bb-aba8-401b-89a3-0a1cf1f1f42b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:43.388220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dd1bb-aba8-401b-89a3-0a1cf1f1f42b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:43.398186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dfe0e-bda6-4bc2-bcfb-3595f48ad4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:43.398908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dfe0e-bda6-4bc2-bcfb-3595f48ad4be service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:43.399262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dfe0e-bda6-4bc2-bcfb-3595f48ad4be service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:43.399673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dfe0e-bda6-4bc2-bcfb-3595f48ad4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:43.410053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dfe0e-bda6-4bc2-bcfb-3595f48ad4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:43.411716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dfe0e-bda6-4bc2-bcfb-3595f48ad4be service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:43.421786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 658/1311] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:22:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:22:57.854110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84f86-ff0a-4401-98d7-d2af61e1c8ca None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:57.855106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84f86-ff0a-4401-98d7-d2af61e1c8ca None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:57.855106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f84f86-ff0a-4401-98d7-d2af61e1c8ca None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:57.857883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 654/1312] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:22:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:22:57.868616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc72c2-975f-4706-b453-ba911b1e64d1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:57.869326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc72c2-975f-4706-b453-ba911b1e64d1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:57.869484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc72c2-975f-4706-b453-ba911b1e64d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:57.899397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f3cc72c2-975f-4706-b453-ba911b1e64d1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:22:57.900634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f3cc72c2-975f-4706-b453-ba911b1e64d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:22:57.911440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 659/1313] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:22:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:22:57.937524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f84f86-ff0a-4401-98d7-d2af61e1c8ca None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:22:57.959199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f84f86-ff0a-4401-98d7-d2af61e1c8ca None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:22:57.965227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0361f9-8bfe-4730-86c1-1bec13aa3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:22:57.965868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0361f9-8bfe-4730-86c1-1bec13aa3439 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:22:57.966144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0361f9-8bfe-4730-86c1-1bec13aa3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:22:57.966412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0361f9-8bfe-4730-86c1-1bec13aa3439 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:22:57.967143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0361f9-8bfe-4730-86c1-1bec13aa3439 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:22:57.969026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0361f9-8bfe-4730-86c1-1bec13aa3439 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:22:57.982770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 655/1314] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:22:57 2021] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:23:00.067960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb81bb-abcd-4613-a1b0-d1c6b98428db None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:00.069043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb81bb-abcd-4613-a1b0-d1c6b98428db None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:00.069043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb81bb-abcd-4613-a1b0-d1c6b98428db None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:00.072105 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 660/1315] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:00.079424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b9f24-e536-4073-a306-26c8a37c1fb3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:00.080209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b9f24-e536-4073-a306-26c8a37c1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:00.080389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b9f24-e536-4073-a306-26c8a37c1fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:00.101330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5a6b9f24-e536-4073-a306-26c8a37c1fb3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:00.102526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5a6b9f24-e536-4073-a306-26c8a37c1fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:00.111447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 656/1316] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:00.135663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb81bb-abcd-4613-a1b0-d1c6b98428db None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:00.148465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb81bb-abcd-4613-a1b0-d1c6b98428db None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:00.153825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:00.154652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:00.154929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:00.155202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] PATH_INFO: `/v3/projects/09cd987f148b4be7a154da0ddc85394f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:00.166494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] RBAC: Authorizing `identity:get_project(project_id=09cd987f148b4be7a154da0ddc85394f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:00.168662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:00.179400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 661/1317] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:23:00 2021] GET /identity/v3/projects/09cd987f148b4be7a154da0ddc85394f => generated 361 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:00.179598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b9f24-e536-4073-a306-26c8a37c1fb3 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:00.188106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b9f24-e536-4073-a306-26c8a37c1fb3 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:00.194768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e22005-2b03-458f-adc9-667b0a0da8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:00.195466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22005-2b03-458f-adc9-667b0a0da8bb admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:00.195748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22005-2b03-458f-adc9-667b0a0da8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:00.196020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e22005-2b03-458f-adc9-667b0a0da8bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:00.196803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e22005-2b03-458f-adc9-667b0a0da8bb admin admin] RBAC: Adding query filter params (scope.project.id=09cd987f148b4be7a154da0ddc85394f) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:23:00.197113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e22005-2b03-458f-adc9-667b0a0da8bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:00.198980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e22005-2b03-458f-adc9-667b0a0da8bb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:00.206750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 657/1318] 10.222.0.58 () {56 vars in 1232 bytes} [Fri Aug 27 03:23:00 2021] GET /identity/v3/role_assignments?scope.project.id=09cd987f148b4be7a154da0ddc85394f => generated 526 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:00.213588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:00.224621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0663cb-ab25-4ec4-a8fc-0dadf96e4b5c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:00.230145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f17dc3-68b5-4584-920d-77c84b7a16d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:00.231031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f17dc3-68b5-4584-920d-77c84b7a16d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:00.231318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f17dc3-68b5-4584-920d-77c84b7a16d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:00.231644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f17dc3-68b5-4584-920d-77c84b7a16d3 admin admin] PATH_INFO: `/v3/users/d7b306af82c04083a425211dfe8127d1` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:00.246249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f17dc3-68b5-4584-920d-77c84b7a16d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=d7b306af82c04083a425211dfe8127d1)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:00.248492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f17dc3-68b5-4584-920d-77c84b7a16d3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:00.250320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 662/1319] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:00 2021] GET /identity/v3/users/d7b306af82c04083a425211dfe8127d1 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:02.463561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f71c-2b17-4263-8ad3-da1714e9d988 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:02.464439 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f71c-2b17-4263-8ad3-da1714e9d988 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:02.464439 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f71c-2b17-4263-8ad3-da1714e9d988 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:02.467288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 658/1320] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:02.474152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef49c3-89a4-44ec-a91b-426c39c3b1f3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:02.474965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef49c3-89a4-44ec-a91b-426c39c3b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:02.475122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef49c3-89a4-44ec-a91b-426c39c3b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:02.499715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-fcef49c3-89a4-44ec-a91b-426c39c3b1f3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:02.500895 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fcef49c3-89a4-44ec-a91b-426c39c3b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:02.511378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 663/1321] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:02.536312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f71c-2b17-4263-8ad3-da1714e9d988 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:02.557712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f71c-2b17-4263-8ad3-da1714e9d988 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:02.563733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:02.564560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:02.564840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:02.565102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] PATH_INFO: `/v3/projects/2459305174fb41a1b648a70650c64c30` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:02.577574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2459305174fb41a1b648a70650c64c30)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:02.579775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:02.581539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 659/1322] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:23:02 2021] GET /identity/v3/projects/2459305174fb41a1b648a70650c64c30 => generated 312 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:02.588503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef49c3-89a4-44ec-a91b-426c39c3b1f3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:02.597574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef49c3-89a4-44ec-a91b-426c39c3b1f3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:02.602828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9e109-09f5-41e6-a962-e166faffb385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:02.603506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e109-09f5-41e6-a962-e166faffb385 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:02.603785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e109-09f5-41e6-a962-e166faffb385 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:02.604053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9e109-09f5-41e6-a962-e166faffb385 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:02.604823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9e109-09f5-41e6-a962-e166faffb385 admin admin] RBAC: Adding query filter params (scope.project.id=2459305174fb41a1b648a70650c64c30) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:23:02.605123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9e109-09f5-41e6-a962-e166faffb385 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:02.606977 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9e109-09f5-41e6-a962-e166faffb385 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:02.613643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 664/1323] 10.222.0.58 () {56 vars in 1232 bytes} [Fri Aug 27 03:23:02 2021] GET /identity/v3/role_assignments?scope.project.id=2459305174fb41a1b648a70650c64c30 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:02.619906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:02.630088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e8929-c09b-40e0-9956-80f19b1033c4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:02.635391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46315284-7d5c-4d5b-96e1-ac6d71103dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:02.636282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315284-7d5c-4d5b-96e1-ac6d71103dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:02.636563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315284-7d5c-4d5b-96e1-ac6d71103dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:02.636834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315284-7d5c-4d5b-96e1-ac6d71103dd8 admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:02.651636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46315284-7d5c-4d5b-96e1-ac6d71103dd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:02.654996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46315284-7d5c-4d5b-96e1-ac6d71103dd8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:02.657782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 660/1324] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:02 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:04.790441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cc3b1-d0a5-4451-88a2-89691bd1d32d None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:04.791393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cc3b1-d0a5-4451-88a2-89691bd1d32d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:04.791393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cc3b1-d0a5-4451-88a2-89691bd1d32d None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:04.794324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 665/1325] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:04.804175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1605-603f-4e8a-a761-48bae49a7c93 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:04.804611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1605-603f-4e8a-a761-48bae49a7c93 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:04.804722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a1605-603f-4e8a-a761-48bae49a7c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:04.832486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-968a1605-603f-4e8a-a761-48bae49a7c93 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:04.834384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-968a1605-603f-4e8a-a761-48bae49a7c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:04.848815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 661/1326] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:04.873310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cc3b1-d0a5-4451-88a2-89691bd1d32d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:04.889223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cc3b1-d0a5-4451-88a2-89691bd1d32d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:04.896174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:04.897429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:04.897779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:04.898062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] PATH_INFO: `/v3/projects/29ce62da2562407c9e293fa3163cb912` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:04.915281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] RBAC: Authorizing `identity:get_project(project_id=29ce62da2562407c9e293fa3163cb912)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:04.917390 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:04.919102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 666/1327] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:23:04 2021] GET /identity/v3/projects/29ce62da2562407c9e293fa3163cb912 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:04.926082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a1605-603f-4e8a-a761-48bae49a7c93 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:04.936173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a1605-603f-4e8a-a761-48bae49a7c93 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:04.942044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:04.942689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:04.942974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:04.943312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:04.944091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] RBAC: Adding query filter params (scope.project.id=29ce62da2562407c9e293fa3163cb912) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:23:04.944392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:04.946249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:04.952516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 662/1328] 10.222.0.58 () {56 vars in 1232 bytes} [Fri Aug 27 03:23:04 2021] GET /identity/v3/role_assignments?scope.project.id=29ce62da2562407c9e293fa3163cb912 => generated 877 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:04.959213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:04.969989 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3997c-feea-4666-92e8-9ebfd92f548c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:04.975647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18acd1-8456-49fa-b1e3-e0bf0763efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:04.976533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18acd1-8456-49fa-b1e3-e0bf0763efaa admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:04.976812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18acd1-8456-49fa-b1e3-e0bf0763efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:04.977088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18acd1-8456-49fa-b1e3-e0bf0763efaa admin admin] PATH_INFO: `/v3/users/b3f5f7fb888b40f49938469848f70fd4` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:04.992618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18acd1-8456-49fa-b1e3-e0bf0763efaa admin admin] RBAC: Authorizing `identity:get_user(user_id=b3f5f7fb888b40f49938469848f70fd4)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:04.994757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18acd1-8456-49fa-b1e3-e0bf0763efaa admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:04.996455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 667/1329] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:04 2021] GET /identity/v3/users/b3f5f7fb888b40f49938469848f70fd4 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:05.003242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:05.012996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13d06-d729-4d42-9a50-70f9f21a9b62 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:05.017677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9fe9c-b005-42dd-bec2-058fc5431959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:05.018533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9fe9c-b005-42dd-bec2-058fc5431959 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:05.018811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9fe9c-b005-42dd-bec2-058fc5431959 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:05.019083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9fe9c-b005-42dd-bec2-058fc5431959 admin admin] PATH_INFO: `/v3/users/61851fbcb8f94386a744419feeeb37d0` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:05.036424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9fe9c-b005-42dd-bec2-058fc5431959 admin admin] RBAC: Authorizing `identity:get_user(user_id=61851fbcb8f94386a744419feeeb37d0)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:05.036424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9fe9c-b005-42dd-bec2-058fc5431959 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:05.036424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 663/1330] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:05 2021] GET /identity/v3/users/61851fbcb8f94386a744419feeeb37d0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:07.275828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6086a7-1f8c-469e-b98f-92981c27a9e8 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:07.276273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6086a7-1f8c-469e-b98f-92981c27a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:07.276386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6086a7-1f8c-469e-b98f-92981c27a9e8 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:07.278188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 668/1331] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:07.285273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843660ad-b06c-43d8-a2fe-40afb7037002 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:07.286014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843660ad-b06c-43d8-a2fe-40afb7037002 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:07.286240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843660ad-b06c-43d8-a2fe-40afb7037002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:07.306145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-843660ad-b06c-43d8-a2fe-40afb7037002 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:07.307378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-843660ad-b06c-43d8-a2fe-40afb7037002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:07.316813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 664/1332] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:07.341006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6086a7-1f8c-469e-b98f-92981c27a9e8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:07.355644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6086a7-1f8c-469e-b98f-92981c27a9e8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:07.362321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:07.363593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:07.363962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:07.364361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] PATH_INFO: `/v3/projects/5f106e34074d41a083ed6d551071767f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:07.385013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] RBAC: Authorizing `identity:get_project(project_id=5f106e34074d41a083ed6d551071767f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:07.387088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:07.388965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 669/1333] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:23:07 2021] GET /identity/v3/projects/5f106e34074d41a083ed6d551071767f => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:07.396129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843660ad-b06c-43d8-a2fe-40afb7037002 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:07.405883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843660ad-b06c-43d8-a2fe-40afb7037002 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:07.412570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:07.413245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:07.413523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:07.413793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:07.414667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] RBAC: Adding query filter params (scope.project.id=5f106e34074d41a083ed6d551071767f) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:23:07.414978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:07.416883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:07.424333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 665/1334] 10.222.0.58 () {56 vars in 1232 bytes} [Fri Aug 27 03:23:07 2021] GET /identity/v3/role_assignments?scope.project.id=5f106e34074d41a083ed6d551071767f => generated 1934 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:23:07.431891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:07.447177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a4110-0217-48c9-b800-9bea1e35737a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:07.454197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9d43c-7fde-4931-92e3-de47fdeec45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:07.455572 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d43c-7fde-4931-92e3-de47fdeec45c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:07.456014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d43c-7fde-4931-92e3-de47fdeec45c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:07.456425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d43c-7fde-4931-92e3-de47fdeec45c admin admin] PATH_INFO: `/v3/users/38b18dde844743d58215f4178220d7e6` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:07.478495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9d43c-7fde-4931-92e3-de47fdeec45c admin admin] RBAC: Authorizing `identity:get_user(user_id=38b18dde844743d58215f4178220d7e6)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:07.480706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9d43c-7fde-4931-92e3-de47fdeec45c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:07.482381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 670/1335] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:07 2021] GET /identity/v3/users/38b18dde844743d58215f4178220d7e6 => generated 283 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:07.489642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:07.500495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08741555-9cc6-48cc-a963-a821f0a24423 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:07.505760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454da80d-f93a-4f5a-9e26-7f8565a53982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:07.506646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da80d-f93a-4f5a-9e26-7f8565a53982 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:07.506930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da80d-f93a-4f5a-9e26-7f8565a53982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:07.507207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da80d-f93a-4f5a-9e26-7f8565a53982 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:07.508710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454da80d-f93a-4f5a-9e26-7f8565a53982 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:07.510534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454da80d-f93a-4f5a-9e26-7f8565a53982 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:07.512212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 666/1336] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:07 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:09.723288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aeb54-d518-4c17-b513-c0e9f6565787 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:09.724265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aeb54-d518-4c17-b513-c0e9f6565787 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:09.724265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aeb54-d518-4c17-b513-c0e9f6565787 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:09.726176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 671/1337] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:09.732829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0b71-a943-4678-885a-8eeb700ce800 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:09.733300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0b71-a943-4678-885a-8eeb700ce800 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:09.733410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0b71-a943-4678-885a-8eeb700ce800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:09.755389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-976d0b71-a943-4678-885a-8eeb700ce800 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:09.757216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-976d0b71-a943-4678-885a-8eeb700ce800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:09.765619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 667/1338] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:09.798255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aeb54-d518-4c17-b513-c0e9f6565787 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:09.814631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aeb54-d518-4c17-b513-c0e9f6565787 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:09.820197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:09.821041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:09.821320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:09.821594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] PATH_INFO: `/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:09.832315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eb3a0e4cb1d4b259b17107aefbb397b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:09.834444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:09.836175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 672/1339] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:23:09 2021] GET /identity/v3/projects/6eb3a0e4cb1d4b259b17107aefbb397b => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:09.846215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0b71-a943-4678-885a-8eeb700ce800 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:09.856043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0b71-a943-4678-885a-8eeb700ce800 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:09.860959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:09.861591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:09.861863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:09.862131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:09.862888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] RBAC: Adding query filter params (scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:23:09.863188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:09.865184 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:09.871942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 668/1340] 10.222.0.58 () {56 vars in 1232 bytes} [Fri Aug 27 03:23:09 2021] GET /identity/v3/role_assignments?scope.project.id=6eb3a0e4cb1d4b259b17107aefbb397b => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:23:09.878700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:09.889326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f1e95-e8de-43cb-8cdb-2b2d9e664289 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:09.895737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2f65b-051f-4a50-983d-4cf13bfea639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:09.896812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f65b-051f-4a50-983d-4cf13bfea639 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:09.897137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f65b-051f-4a50-983d-4cf13bfea639 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:09.897398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2f65b-051f-4a50-983d-4cf13bfea639 admin admin] PATH_INFO: `/v3/users/bb746cac3a914fd5a9829fbc109253e7` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:09.898714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2f65b-051f-4a50-983d-4cf13bfea639 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb746cac3a914fd5a9829fbc109253e7)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:09.900864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2f65b-051f-4a50-983d-4cf13bfea639 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:09.902454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 673/1341] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:09 2021] GET /identity/v3/users/bb746cac3a914fd5a9829fbc109253e7 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:09.909444 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:09.926448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9de3-ddce-490e-b1ad-34c51f2ec0df admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:09.933159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33380aa-b44f-4109-a8f4-f06946fc33f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:09.934018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33380aa-b44f-4109-a8f4-f06946fc33f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:09.934295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33380aa-b44f-4109-a8f4-f06946fc33f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:09.934566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33380aa-b44f-4109-a8f4-f06946fc33f1 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:09.935914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33380aa-b44f-4109-a8f4-f06946fc33f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:09.937743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33380aa-b44f-4109-a8f4-f06946fc33f1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:09.939339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 669/1342] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:09 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:12.155097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f5ab-7a93-4a97-8388-744d2509d780 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:12.155731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f5ab-7a93-4a97-8388-744d2509d780 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:12.155731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f5ab-7a93-4a97-8388-744d2509d780 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:12.157476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 674/1343] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:12.164695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4595d-6ffa-448e-aca5-791cd7896fe8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:12.165412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4595d-6ffa-448e-aca5-791cd7896fe8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:12.165554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4595d-6ffa-448e-aca5-791cd7896fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:12.190444 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f3e4595d-6ffa-448e-aca5-791cd7896fe8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:12.191871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f3e4595d-6ffa-448e-aca5-791cd7896fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:12.200935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 670/1344] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:12.225764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0f5ab-7a93-4a97-8388-744d2509d780 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:12.244978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0f5ab-7a93-4a97-8388-744d2509d780 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:12.251040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:12.251921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:12.252195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:12.252461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] PATH_INFO: `/v3/projects/dd18f6074b9647bca69baffc389eb123` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:12.253780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] RBAC: Authorizing `identity:get_project(project_id=dd18f6074b9647bca69baffc389eb123)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:12.255690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:12.257421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 675/1345] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:23:12 2021] GET /identity/v3/projects/dd18f6074b9647bca69baffc389eb123 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:12.264505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4595d-6ffa-448e-aca5-791cd7896fe8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:12.274055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4595d-6ffa-448e-aca5-791cd7896fe8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:12.279177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335ed0c-65b2-4cc8-9b54-5e88214c238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:12.279851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335ed0c-65b2-4cc8-9b54-5e88214c238b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:12.280133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335ed0c-65b2-4cc8-9b54-5e88214c238b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:12.280411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335ed0c-65b2-4cc8-9b54-5e88214c238b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:12.281208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335ed0c-65b2-4cc8-9b54-5e88214c238b admin admin] RBAC: Adding query filter params (scope.project.id=dd18f6074b9647bca69baffc389eb123) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:23:12.281509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335ed0c-65b2-4cc8-9b54-5e88214c238b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:12.283378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335ed0c-65b2-4cc8-9b54-5e88214c238b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:12.289479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 671/1346] 10.222.0.58 () {56 vars in 1232 bytes} [Fri Aug 27 03:23:12 2021] GET /identity/v3/role_assignments?scope.project.id=dd18f6074b9647bca69baffc389eb123 => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:23:12.296268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:12.308779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a744-384d-4603-a593-0b30d960b056 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:12.313825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecff8ad-8a47-4c3b-a202-b566e5c16310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:12.314736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecff8ad-8a47-4c3b-a202-b566e5c16310 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:12.315014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecff8ad-8a47-4c3b-a202-b566e5c16310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:12.315282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecff8ad-8a47-4c3b-a202-b566e5c16310 admin admin] PATH_INFO: `/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:12.316568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecff8ad-8a47-4c3b-a202-b566e5c16310 admin admin] RBAC: Authorizing `identity:get_user(user_id=7fef28dc8c914392b02ef34cf0bcbb9c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:12.318461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecff8ad-8a47-4c3b-a202-b566e5c16310 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:12.320402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 676/1347] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:12 2021] GET /identity/v3/users/7fef28dc8c914392b02ef34cf0bcbb9c => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:14.502430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f421b4a-8310-4f3e-afd1-b7ead5c1a4d2 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:14.503450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f421b4a-8310-4f3e-afd1-b7ead5c1a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:14.503450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f421b4a-8310-4f3e-afd1-b7ead5c1a4d2 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:14.507164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 672/1348] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:14.519688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66befac9-201e-4f80-bc3e-99f3d92a051a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:14.520183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66befac9-201e-4f80-bc3e-99f3d92a051a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:14.520321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66befac9-201e-4f80-bc3e-99f3d92a051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:14.540098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-66befac9-201e-4f80-bc3e-99f3d92a051a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:14.541304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-66befac9-201e-4f80-bc3e-99f3d92a051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:14.550742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 677/1349] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:23:14.576621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f421b4a-8310-4f3e-afd1-b7ead5c1a4d2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:14.592360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f421b4a-8310-4f3e-afd1-b7ead5c1a4d2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:14.597540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:14.598419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:14.598680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:14.598984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] PATH_INFO: `/v3/projects/e8d002cb0098425b8f076a4ca5c2290f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:14.614522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=e8d002cb0098425b8f076a4ca5c2290f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:14.617437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:14.619385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 673/1350] 10.222.0.58 () {56 vars in 1208 bytes} [Fri Aug 27 03:23:14 2021] GET /identity/v3/projects/e8d002cb0098425b8f076a4ca5c2290f => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:14.626166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66befac9-201e-4f80-bc3e-99f3d92a051a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:14.635764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66befac9-201e-4f80-bc3e-99f3d92a051a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:14.641678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce86d25-b11f-41bf-8fd3-f9b992ab214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:14.642328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce86d25-b11f-41bf-8fd3-f9b992ab214a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:14.642605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce86d25-b11f-41bf-8fd3-f9b992ab214a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:14.642872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce86d25-b11f-41bf-8fd3-f9b992ab214a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:14.643664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce86d25-b11f-41bf-8fd3-f9b992ab214a admin admin] RBAC: Adding query filter params (scope.project.id=e8d002cb0098425b8f076a4ca5c2290f) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:23:14.643971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce86d25-b11f-41bf-8fd3-f9b992ab214a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:14.645951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce86d25-b11f-41bf-8fd3-f9b992ab214a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:14.651740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 678/1351] 10.222.0.58 () {56 vars in 1232 bytes} [Fri Aug 27 03:23:14 2021] GET /identity/v3/role_assignments?scope.project.id=e8d002cb0098425b8f076a4ca5c2290f => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:14.658823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:14.670548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef719c9-fb12-43b3-b0f8-2faae0c79bd7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:14.675548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722c2c2-2f64-4cec-8485-b518dde761be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:14.676416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c2c2-2f64-4cec-8485-b518dde761be admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:14.676693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c2c2-2f64-4cec-8485-b518dde761be admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:14.676965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c2c2-2f64-4cec-8485-b518dde761be admin admin] PATH_INFO: `/v3/users/33ae0fd9ad8a485b8e72fc99844c982c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:14.691160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722c2c2-2f64-4cec-8485-b518dde761be admin admin] RBAC: Authorizing `identity:get_user(user_id=33ae0fd9ad8a485b8e72fc99844c982c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:14.693694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722c2c2-2f64-4cec-8485-b518dde761be admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:14.695171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 674/1352] 10.222.0.58 () {56 vars in 1199 bytes} [Fri Aug 27 03:23:14 2021] GET /identity/v3/users/33ae0fd9ad8a485b8e72fc99844c982c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:23:20.009853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a45d0-ec7e-43d0-b823-b12235daf443 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:20.010424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a45d0-ec7e-43d0-b823-b12235daf443 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:20.010424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a45d0-ec7e-43d0-b823-b12235daf443 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:20.012313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 679/1353] 10.222.0.58 () {54 vars in 918 bytes} [Fri Aug 27 03:23:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:20.019262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe373e-d869-4119-a1c8-1cb1d728e240 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:20.019756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe373e-d869-4119-a1c8-1cb1d728e240 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:20.019858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe373e-d869-4119-a1c8-1cb1d728e240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:20.045072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-33fe373e-d869-4119-a1c8-1cb1d728e240 None None] MFA Rules not processed for user `58838486fa5f49c4bca67ad01713fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:20.046283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-33fe373e-d869-4119-a1c8-1cb1d728e240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:20.056595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 675/1354] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 27 03:23:20 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:20.075764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362689-21a0-4bce-8a11-8dfb74219942 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:20.076087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362689-21a0-4bce-8a11-8dfb74219942 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:20.076406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362689-21a0-4bce-8a11-8dfb74219942 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:20.078250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 680/1355] 10.222.0.58 () {54 vars in 918 bytes} [Fri Aug 27 03:23:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:20.084042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447f782-5675-4375-af9e-5b90b5b8c707 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:20.084526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447f782-5675-4375-af9e-5b90b5b8c707 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:20.084814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447f782-5675-4375-af9e-5b90b5b8c707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:20.103946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d447f782-5675-4375-af9e-5b90b5b8c707 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:20.105161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d447f782-5675-4375-af9e-5b90b5b8c707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:20.119046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 676/1356] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Aug 27 03:23:20 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:22.905217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac6aba-8a96-406e-a58a-02b58912b485 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:22.905842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac6aba-8a96-406e-a58a-02b58912b485 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:22.905842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac6aba-8a96-406e-a58a-02b58912b485 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:22.907545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 681/1357] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:22.914943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfdd50-b486-4d28-b15f-fd0597faa0b6 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:22.915671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfdd50-b486-4d28-b15f-fd0597faa0b6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:22.915790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfdd50-b486-4d28-b15f-fd0597faa0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:22.947248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8ecfdd50-b486-4d28-b15f-fd0597faa0b6 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:22.948505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8ecfdd50-b486-4d28-b15f-fd0597faa0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:22.961384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 677/1358] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:23.011236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac6aba-8a96-406e-a58a-02b58912b485 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:23.027984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac6aba-8a96-406e-a58a-02b58912b485 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:23.034385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c69b09-2cab-47f6-8167-6ab41b9d0943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:23.035021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c69b09-2cab-47f6-8167-6ab41b9d0943 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:23.035300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c69b09-2cab-47f6-8167-6ab41b9d0943 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:23.035600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c69b09-2cab-47f6-8167-6ab41b9d0943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:23.044207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c69b09-2cab-47f6-8167-6ab41b9d0943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:23.045797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c69b09-2cab-47f6-8167-6ab41b9d0943 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:23.055918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 682/1359] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:24.460762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1603e-00bf-4d2e-b2aa-e1e4de18fb39 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:24.461648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1603e-00bf-4d2e-b2aa-e1e4de18fb39 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:24.461648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1603e-00bf-4d2e-b2aa-e1e4de18fb39 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:24.464560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 678/1360] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:24 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:24.473716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51886-0d88-44cb-a5d3-f82006407c61 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:24.474510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51886-0d88-44cb-a5d3-f82006407c61 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:24.475168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51886-0d88-44cb-a5d3-f82006407c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:24.496812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-6ab51886-0d88-44cb-a5d3-f82006407c61 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:24.498026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6ab51886-0d88-44cb-a5d3-f82006407c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:24.508294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 683/1361] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:24.668994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1603e-00bf-4d2e-b2aa-e1e4de18fb39 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:24.695380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1603e-00bf-4d2e-b2aa-e1e4de18fb39 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:24.705252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5770d3-c7bf-4305-8ff8-4cb3bfc8fd8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:24.706097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5770d3-c7bf-4305-8ff8-4cb3bfc8fd8d service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:24.706483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5770d3-c7bf-4305-8ff8-4cb3bfc8fd8d service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:24.706804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5770d3-c7bf-4305-8ff8-4cb3bfc8fd8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:24.717307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5770d3-c7bf-4305-8ff8-4cb3bfc8fd8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:24.718922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5770d3-c7bf-4305-8ff8-4cb3bfc8fd8d service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:24.729313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 679/1362] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:26.156843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79278-4b56-4f6b-967d-7c57c13828c9 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:26.157432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79278-4b56-4f6b-967d-7c57c13828c9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:26.157432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d79278-4b56-4f6b-967d-7c57c13828c9 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:26.160259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 684/1363] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:26.166843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8295b-9aa2-45dd-83e3-0c5ed55ce658 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:26.167364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8295b-9aa2-45dd-83e3-0c5ed55ce658 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:26.167480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8295b-9aa2-45dd-83e3-0c5ed55ce658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:26.186611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b8c8295b-9aa2-45dd-83e3-0c5ed55ce658 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:26.187829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b8c8295b-9aa2-45dd-83e3-0c5ed55ce658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:26.196630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 680/1364] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:23:26.351383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79278-4b56-4f6b-967d-7c57c13828c9 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:26.367899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d79278-4b56-4f6b-967d-7c57c13828c9 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:26.375018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36b0d-c023-4471-a3d9-e71a765f8ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:26.375713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36b0d-c023-4471-a3d9-e71a765f8ada service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:26.375990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36b0d-c023-4471-a3d9-e71a765f8ada service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:26.376259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36b0d-c023-4471-a3d9-e71a765f8ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:26.385624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36b0d-c023-4471-a3d9-e71a765f8ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:26.387200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36b0d-c023-4471-a3d9-e71a765f8ada service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:26.396934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 685/1365] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:27.790023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e1d91-74b0-4263-baa7-9f96e2e12e7e None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:27.790614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e1d91-74b0-4263-baa7-9f96e2e12e7e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:27.790614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e1d91-74b0-4263-baa7-9f96e2e12e7e None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:27.792350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 681/1366] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:27.799025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412102e5-4976-48c7-aea6-3fbcda6de039 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:27.799834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412102e5-4976-48c7-aea6-3fbcda6de039 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:27.800008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412102e5-4976-48c7-aea6-3fbcda6de039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:27.820889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-412102e5-4976-48c7-aea6-3fbcda6de039 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:27.822083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-412102e5-4976-48c7-aea6-3fbcda6de039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:27.830885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 686/1367] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:27.986610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e1d91-74b0-4263-baa7-9f96e2e12e7e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:28.003757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e1d91-74b0-4263-baa7-9f96e2e12e7e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:28.009475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c846-e42e-4b42-9635-821aeb4519c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:28.010108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c846-e42e-4b42-9635-821aeb4519c4 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:28.010405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c846-e42e-4b42-9635-821aeb4519c4 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:28.010661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c846-e42e-4b42-9635-821aeb4519c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:28.018580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c846-e42e-4b42-9635-821aeb4519c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:28.020195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c846-e42e-4b42-9635-821aeb4519c4 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:28.030969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 682/1368] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:29.475661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7a926-0128-4832-8932-c3feba6f6e2c None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:29.476211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7a926-0128-4832-8932-c3feba6f6e2c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:29.476211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7a926-0128-4832-8932-c3feba6f6e2c None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:29.478049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 687/1369] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:29.483834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf515-b324-4fc4-bbfa-e9e27536b85c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:29.484313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf515-b324-4fc4-bbfa-e9e27536b85c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:29.484408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf515-b324-4fc4-bbfa-e9e27536b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:29.503871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-26ccf515-b324-4fc4-bbfa-e9e27536b85c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:29.505168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-26ccf515-b324-4fc4-bbfa-e9e27536b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:29.513660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 683/1370] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:29.668413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7a926-0128-4832-8932-c3feba6f6e2c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:29.686947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7a926-0128-4832-8932-c3feba6f6e2c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:29.693752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb84c7-6392-426c-a1b0-a5cad8897a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:29.694382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb84c7-6392-426c-a1b0-a5cad8897a8e service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:29.694661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb84c7-6392-426c-a1b0-a5cad8897a8e service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:29.694924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb84c7-6392-426c-a1b0-a5cad8897a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:29.703362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb84c7-6392-426c-a1b0-a5cad8897a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:29.704992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb84c7-6392-426c-a1b0-a5cad8897a8e service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:29.718336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 688/1371] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:31.050189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00b0ce-7c92-40ff-94fa-4b70abb5ac1c None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:31.051069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00b0ce-7c92-40ff-94fa-4b70abb5ac1c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:31.051069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00b0ce-7c92-40ff-94fa-4b70abb5ac1c None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:31.053629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 684/1372] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:23:31.059790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006a3cc-dbe1-456c-a268-bac642a06c4c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:31.060220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006a3cc-dbe1-456c-a268-bac642a06c4c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:31.060333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006a3cc-dbe1-456c-a268-bac642a06c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:31.078856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8006a3cc-dbe1-456c-a268-bac642a06c4c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:31.080076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8006a3cc-dbe1-456c-a268-bac642a06c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:31.088876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 689/1373] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:31.250810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00b0ce-7c92-40ff-94fa-4b70abb5ac1c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:31.267653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00b0ce-7c92-40ff-94fa-4b70abb5ac1c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:31.278720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fed74c-645e-44e1-ba8d-9dde2856e88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:31.279800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed74c-645e-44e1-ba8d-9dde2856e88f service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:31.280229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed74c-645e-44e1-ba8d-9dde2856e88f service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:31.280683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fed74c-645e-44e1-ba8d-9dde2856e88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:31.292388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fed74c-645e-44e1-ba8d-9dde2856e88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:31.294008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fed74c-645e-44e1-ba8d-9dde2856e88f service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:31.304605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 685/1374] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:23:32.627286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee28a3-a150-4de5-b617-f313d27abc21 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:32.628170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee28a3-a150-4de5-b617-f313d27abc21 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:32.628170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee28a3-a150-4de5-b617-f313d27abc21 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:32.630956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 690/1375] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:32.639191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9d7fc-4431-4b04-bb43-aeb9bcd13e85 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:32.639653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9d7fc-4431-4b04-bb43-aeb9bcd13e85 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:32.639785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9d7fc-4431-4b04-bb43-aeb9bcd13e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:32.659791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ebd9d7fc-4431-4b04-bb43-aeb9bcd13e85 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:32.660936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ebd9d7fc-4431-4b04-bb43-aeb9bcd13e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:32.673995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 686/1376] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:32.842044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee28a3-a150-4de5-b617-f313d27abc21 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:32.860693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee28a3-a150-4de5-b617-f313d27abc21 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:32.867384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c195e-2687-480d-a892-667879e6ebe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:32.868060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c195e-2687-480d-a892-667879e6ebe8 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:32.868339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c195e-2687-480d-a892-667879e6ebe8 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:32.868613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c195e-2687-480d-a892-667879e6ebe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:32.876804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c195e-2687-480d-a892-667879e6ebe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:32.878389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c195e-2687-480d-a892-667879e6ebe8 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:32.889191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 691/1377] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:34.233120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067989eb-2206-4ba9-a837-f5d19fccb4ba None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:34.233697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067989eb-2206-4ba9-a837-f5d19fccb4ba None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:34.233697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067989eb-2206-4ba9-a837-f5d19fccb4ba None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:34.235553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 687/1378] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:34.241630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469fa2-f59f-4e9a-a49d-c009eb670a00 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:34.242117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469fa2-f59f-4e9a-a49d-c009eb670a00 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:34.242220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469fa2-f59f-4e9a-a49d-c009eb670a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:34.261724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-24469fa2-f59f-4e9a-a49d-c009eb670a00 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:34.262906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-24469fa2-f59f-4e9a-a49d-c009eb670a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:34.271312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 692/1379] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:34.428279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067989eb-2206-4ba9-a837-f5d19fccb4ba None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:34.445398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067989eb-2206-4ba9-a837-f5d19fccb4ba None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:34.451778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2707c-308a-4d46-9f05-1cdc261ca214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:34.452421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2707c-308a-4d46-9f05-1cdc261ca214 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:34.452698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2707c-308a-4d46-9f05-1cdc261ca214 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:34.452972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2707c-308a-4d46-9f05-1cdc261ca214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:34.461981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2707c-308a-4d46-9f05-1cdc261ca214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:34.463634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2707c-308a-4d46-9f05-1cdc261ca214 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:34.473614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 688/1380] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:35.819436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0300d-1d46-4bd6-b8ee-52ade82e87c1 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:35.820012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0300d-1d46-4bd6-b8ee-52ade82e87c1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:35.820012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0300d-1d46-4bd6-b8ee-52ade82e87c1 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:35.822661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 693/1381] 10.222.0.58 () {54 vars in 911 bytes} [Fri Aug 27 03:23:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:35.829406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ac1a-1832-41e1-9dd8-46abe274b3aa None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:35.829876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ac1a-1832-41e1-9dd8-46abe274b3aa None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:35.830747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ac1a-1832-41e1-9dd8-46abe274b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:35.857683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8131ac1a-1832-41e1-9dd8-46abe274b3aa None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:35.858936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8131ac1a-1832-41e1-9dd8-46abe274b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:35.867533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 689/1382] 10.222.0.58 () {58 vars in 1009 bytes} [Fri Aug 27 03:23:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:36.023877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0300d-1d46-4bd6-b8ee-52ade82e87c1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:36.050727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0300d-1d46-4bd6-b8ee-52ade82e87c1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:36.059391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80a4dc-12e4-40d9-a90c-d0d3b7854a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:36.060054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a4dc-12e4-40d9-a90c-d0d3b7854a55 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:36.060341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a4dc-12e4-40d9-a90c-d0d3b7854a55 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:36.060614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80a4dc-12e4-40d9-a90c-d0d3b7854a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:36.070601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a4dc-12e4-40d9-a90c-d0d3b7854a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:36.072978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80a4dc-12e4-40d9-a90c-d0d3b7854a55 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:36.086292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 694/1383] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:38.127600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0890e6-19dc-44fe-a801-86e53c4ffbae None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:38.128535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0890e6-19dc-44fe-a801-86e53c4ffbae None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:38.128535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0890e6-19dc-44fe-a801-86e53c4ffbae None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:38.131174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 690/1384] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:38.137177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3c2c-6d31-455f-b7db-8883d818cf08 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:38.137623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3c2c-6d31-455f-b7db-8883d818cf08 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:38.137736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3c2c-6d31-455f-b7db-8883d818cf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:38.156245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7f6f3c2c-6d31-455f-b7db-8883d818cf08 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:38.157451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7f6f3c2c-6d31-455f-b7db-8883d818cf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:38.165902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 695/1385] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:38.206253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0890e6-19dc-44fe-a801-86e53c4ffbae None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:38.218290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0890e6-19dc-44fe-a801-86e53c4ffbae None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:38.222331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3ad27-9cb6-40bc-b9ce-1499e9fe3db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:38.222963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3ad27-9cb6-40bc-b9ce-1499e9fe3db8 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:38.223236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3ad27-9cb6-40bc-b9ce-1499e9fe3db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:38.223531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3ad27-9cb6-40bc-b9ce-1499e9fe3db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:38.232802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3ad27-9cb6-40bc-b9ce-1499e9fe3db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:38.234236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3ad27-9cb6-40bc-b9ce-1499e9fe3db8 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:38.246446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 691/1386] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:40.683183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2614-9356-4620-96cf-d12335eb8ecb None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:40.683912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2614-9356-4620-96cf-d12335eb8ecb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:40.683912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2614-9356-4620-96cf-d12335eb8ecb None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:40.686208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 696/1387] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:40.692607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfd54-dab7-4148-9b98-d685152d1c2b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:40.693314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfd54-dab7-4148-9b98-d685152d1c2b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:40.693992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edfd54-dab7-4148-9b98-d685152d1c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:40.714026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f5edfd54-dab7-4148-9b98-d685152d1c2b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:40.715227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f5edfd54-dab7-4148-9b98-d685152d1c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:40.726056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 692/1388] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:40.769823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf2614-9356-4620-96cf-d12335eb8ecb None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:40.783128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf2614-9356-4620-96cf-d12335eb8ecb None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:40.789560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6fb0-e38e-42b9-aa85-fe1d81408d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:40.790413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6fb0-e38e-42b9-aa85-fe1d81408d49 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:40.790695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6fb0-e38e-42b9-aa85-fe1d81408d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:40.790976 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6fb0-e38e-42b9-aa85-fe1d81408d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:40.806634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6fb0-e38e-42b9-aa85-fe1d81408d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:40.808065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6fb0-e38e-42b9-aa85-fe1d81408d49 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:40.820188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 697/1389] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:43.462526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440cc7-dfc2-4f94-ad31-a26b7edd4748 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:43.463086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440cc7-dfc2-4f94-ad31-a26b7edd4748 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:43.463086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440cc7-dfc2-4f94-ad31-a26b7edd4748 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:43.464888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 693/1390] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:43.472081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b0e3-9926-4f10-9edb-461cfb3b868e None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:43.472764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b0e3-9926-4f10-9edb-461cfb3b868e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:43.472908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9b0e3-9926-4f10-9edb-461cfb3b868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:43.493732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d6d9b0e3-9926-4f10-9edb-461cfb3b868e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:43.494940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d6d9b0e3-9926-4f10-9edb-461cfb3b868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:43.504430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 698/1391] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:43.553688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440cc7-dfc2-4f94-ad31-a26b7edd4748 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:43.571643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440cc7-dfc2-4f94-ad31-a26b7edd4748 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:43.577560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d1ba5-db73-4641-8f34-231f05e4bbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:43.578200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d1ba5-db73-4641-8f34-231f05e4bbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:43.578485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d1ba5-db73-4641-8f34-231f05e4bbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:43.578754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d1ba5-db73-4641-8f34-231f05e4bbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:43.589311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d1ba5-db73-4641-8f34-231f05e4bbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:43.590764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d1ba5-db73-4641-8f34-231f05e4bbf9 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:43.600491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 694/1392] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:23:45.926671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c794-303d-4a89-a4f1-c2e3f579c870 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:45.928966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c794-303d-4a89-a4f1-c2e3f579c870 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:45.928966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c794-303d-4a89-a4f1-c2e3f579c870 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:45.929440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 699/1393] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:45.936650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96363-de13-450d-a1d3-10fdbe8580cd None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:45.937123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96363-de13-450d-a1d3-10fdbe8580cd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:45.937236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96363-de13-450d-a1d3-10fdbe8580cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:45.963409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-18f96363-de13-450d-a1d3-10fdbe8580cd None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:45.964603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-18f96363-de13-450d-a1d3-10fdbe8580cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:45.973377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 695/1394] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:23:46.013189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c794-303d-4a89-a4f1-c2e3f579c870 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:46.028203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c794-303d-4a89-a4f1-c2e3f579c870 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:46.032485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c52e-543d-417d-b79e-dfeab772fcea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:46.033130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c52e-543d-417d-b79e-dfeab772fcea service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:46.033414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c52e-543d-417d-b79e-dfeab772fcea service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:46.033686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c52e-543d-417d-b79e-dfeab772fcea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:46.044486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c52e-543d-417d-b79e-dfeab772fcea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:46.045930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c52e-543d-417d-b79e-dfeab772fcea service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:46.056641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 700/1395] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:48.416017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0a12-d83e-4f5f-b2d9-647f096ccbf8 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:48.416552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0a12-d83e-4f5f-b2d9-647f096ccbf8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:48.416774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced0a12-d83e-4f5f-b2d9-647f096ccbf8 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:48.419320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 696/1396] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:48.426269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e76e-f093-47eb-b07c-dd18813d6e02 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:48.426722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e76e-f093-47eb-b07c-dd18813d6e02 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:48.427071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2e76e-f093-47eb-b07c-dd18813d6e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:48.450477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-40e2e76e-f093-47eb-b07c-dd18813d6e02 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:48.452408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-40e2e76e-f093-47eb-b07c-dd18813d6e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:48.464194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 701/1397] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:48.506405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced0a12-d83e-4f5f-b2d9-647f096ccbf8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:48.518089 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced0a12-d83e-4f5f-b2d9-647f096ccbf8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:48.524425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15558e29-5be0-4a0b-b7fe-9f6545e6a054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:48.525508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15558e29-5be0-4a0b-b7fe-9f6545e6a054 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:48.525960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15558e29-5be0-4a0b-b7fe-9f6545e6a054 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:48.526408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15558e29-5be0-4a0b-b7fe-9f6545e6a054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:48.539033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15558e29-5be0-4a0b-b7fe-9f6545e6a054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:48.541506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15558e29-5be0-4a0b-b7fe-9f6545e6a054 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:48.555758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 697/1398] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:23:50.774789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51553-730f-4f11-aaae-0615ee4b55ca None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:50.775432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51553-730f-4f11-aaae-0615ee4b55ca None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:50.775432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51553-730f-4f11-aaae-0615ee4b55ca None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:50.777210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 702/1399] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:50.784304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4c5e-4313-4a5b-8dfa-7ff91583233c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:50.785071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4c5e-4313-4a5b-8dfa-7ff91583233c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:50.785214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4c5e-4313-4a5b-8dfa-7ff91583233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:50.808121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-20ba4c5e-4313-4a5b-8dfa-7ff91583233c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:50.809339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-20ba4c5e-4313-4a5b-8dfa-7ff91583233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:50.819690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 698/1400] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:50.874818 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51553-730f-4f11-aaae-0615ee4b55ca None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:50.888864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51553-730f-4f11-aaae-0615ee4b55ca None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:50.893017 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a44e13-e28f-47c3-b5d0-5cf26fdcaa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:50.893652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a44e13-e28f-47c3-b5d0-5cf26fdcaa1d service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:50.893927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a44e13-e28f-47c3-b5d0-5cf26fdcaa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:50.894188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a44e13-e28f-47c3-b5d0-5cf26fdcaa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:50.904174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a44e13-e28f-47c3-b5d0-5cf26fdcaa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:50.905599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a44e13-e28f-47c3-b5d0-5cf26fdcaa1d service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:50.914849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 703/1401] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:53.084214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c582-b44b-45a9-8ae1-3550c87c5efa None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:53.085620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c582-b44b-45a9-8ae1-3550c87c5efa None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:53.085620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9c582-b44b-45a9-8ae1-3550c87c5efa None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:53.087205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 699/1402] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:53.099103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbcaca-5986-4765-b5bd-096ba286a215 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:53.099651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbcaca-5986-4765-b5bd-096ba286a215 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:53.100148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbcaca-5986-4765-b5bd-096ba286a215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:53.121161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-94fbcaca-5986-4765-b5bd-096ba286a215 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:53.122372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-94fbcaca-5986-4765-b5bd-096ba286a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:53.131746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 704/1403] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:53.183631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c582-b44b-45a9-8ae1-3550c87c5efa None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:53.195090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9c582-b44b-45a9-8ae1-3550c87c5efa None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:53.198692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9aef-2a9c-41e4-8ff9-de95f9b8ac67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:53.199328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9aef-2a9c-41e4-8ff9-de95f9b8ac67 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:53.199632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9aef-2a9c-41e4-8ff9-de95f9b8ac67 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:53.199901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9aef-2a9c-41e4-8ff9-de95f9b8ac67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:53.208626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab9aef-2a9c-41e4-8ff9-de95f9b8ac67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:53.210128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab9aef-2a9c-41e4-8ff9-de95f9b8ac67 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:53.219499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 700/1404] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:55.422981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631626-2abe-4095-8a8a-f0af9f60397b None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:55.423516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631626-2abe-4095-8a8a-f0af9f60397b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:55.423516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631626-2abe-4095-8a8a-f0af9f60397b None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:55.425337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 705/1405] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:55.432827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171e16c-22f4-4114-aa92-4827ce8c5152 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:55.433592 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171e16c-22f4-4114-aa92-4827ce8c5152 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:55.433737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171e16c-22f4-4114-aa92-4827ce8c5152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:55.456601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-6171e16c-22f4-4114-aa92-4827ce8c5152 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:55.457798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6171e16c-22f4-4114-aa92-4827ce8c5152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:55.466481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 701/1406] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:55.507785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631626-2abe-4095-8a8a-f0af9f60397b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:55.525051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631626-2abe-4095-8a8a-f0af9f60397b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:55.529693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f3841-2782-40dd-9a80-b7a4c45fb95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:55.530332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3841-2782-40dd-9a80-b7a4c45fb95c service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:55.530613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3841-2782-40dd-9a80-b7a4c45fb95c service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:55.531168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f3841-2782-40dd-9a80-b7a4c45fb95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:55.541927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f3841-2782-40dd-9a80-b7a4c45fb95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:55.544263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f3841-2782-40dd-9a80-b7a4c45fb95c service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:55.561648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 706/1407] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:23:57.754496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f18166-19a1-4e9d-9963-6f3c39ea2082 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:57.755428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f18166-19a1-4e9d-9963-6f3c39ea2082 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:57.755627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f18166-19a1-4e9d-9963-6f3c39ea2082 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:57.758769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 702/1408] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:23:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:23:57.766036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccceb95-d2e2-4266-87c3-795962ef0078 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:57.766773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccceb95-d2e2-4266-87c3-795962ef0078 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:57.766928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccceb95-d2e2-4266-87c3-795962ef0078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:57.787896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-fccceb95-d2e2-4266-87c3-795962ef0078 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:23:57.789104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fccceb95-d2e2-4266-87c3-795962ef0078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:23:57.798708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 707/1409] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:23:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:23:57.837560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f18166-19a1-4e9d-9963-6f3c39ea2082 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:23:57.855773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f18166-19a1-4e9d-9963-6f3c39ea2082 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:23:57.863170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf638e-39b8-4869-ae5e-aa653909949e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:23:57.864070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf638e-39b8-4869-ae5e-aa653909949e service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:23:57.864591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf638e-39b8-4869-ae5e-aa653909949e service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:23:57.864738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf638e-39b8-4869-ae5e-aa653909949e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:23:57.874479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf638e-39b8-4869-ae5e-aa653909949e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:23:57.875984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf638e-39b8-4869-ae5e-aa653909949e service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:23:57.886027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 703/1410] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:23:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:24:00.020222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2059e9-2be8-49d3-aecb-3a7092a9eba5 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:00.021437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2059e9-2be8-49d3-aecb-3a7092a9eba5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:00.021437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2059e9-2be8-49d3-aecb-3a7092a9eba5 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:00.022629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 708/1411] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:00.029787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591abf9e-6dde-4462-83ae-a4ae0368134e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:00.030568 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591abf9e-6dde-4462-83ae-a4ae0368134e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:00.030739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591abf9e-6dde-4462-83ae-a4ae0368134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:00.058897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-591abf9e-6dde-4462-83ae-a4ae0368134e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:00.060136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-591abf9e-6dde-4462-83ae-a4ae0368134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:00.070056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 704/1412] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:24:00.106812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2059e9-2be8-49d3-aecb-3a7092a9eba5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:00.119061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2059e9-2be8-49d3-aecb-3a7092a9eba5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:00.123208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95cc7b-77cc-4287-8b0c-b43cd38858bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:00.123871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cc7b-77cc-4287-8b0c-b43cd38858bc service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:00.124156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cc7b-77cc-4287-8b0c-b43cd38858bc service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:00.124437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95cc7b-77cc-4287-8b0c-b43cd38858bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:00.134661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95cc7b-77cc-4287-8b0c-b43cd38858bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:00.136798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95cc7b-77cc-4287-8b0c-b43cd38858bc service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:00.146827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 709/1413] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:24:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:24:16.817723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e10db6-f69b-4716-adc3-5a007acd5f2f None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:16.818970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e10db6-f69b-4716-adc3-5a007acd5f2f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:16.818970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e10db6-f69b-4716-adc3-5a007acd5f2f None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:16.821439 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 705/1414] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:16.828590 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eebdec-ce49-4c53-84dc-b1d1459b49d3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:16.829058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eebdec-ce49-4c53-84dc-b1d1459b49d3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:16.829160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eebdec-ce49-4c53-84dc-b1d1459b49d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:16.849331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f8eebdec-ce49-4c53-84dc-b1d1459b49d3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:16.850525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f8eebdec-ce49-4c53-84dc-b1d1459b49d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:16.858701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 710/1415] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:24:16.906902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d1299-1703-42e4-b116-d23d58983d6b None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:16.907290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d1299-1703-42e4-b116-d23d58983d6b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:16.907727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d1299-1703-42e4-b116-d23d58983d6b None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:16.910631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 706/1416] 10.222.0.58 () {54 vars in 966 bytes} [Fri Aug 27 03:24:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:16.916568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4882-2b84-4b45-b7e8-1a2f9f5d1c57 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:16.916853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4882-2b84-4b45-b7e8-1a2f9f5d1c57 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:16.917126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4882-2b84-4b45-b7e8-1a2f9f5d1c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:16.946009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-804f4882-2b84-4b45-b7e8-1a2f9f5d1c57 None None] MFA Rules not processed for user `b43f60d8ae5f4e8cb3ba57f76777ac84`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:16.947201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-804f4882-2b84-4b45-b7e8-1a2f9f5d1c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:16.955150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 711/1417] 10.222.0.58 () {58 vars in 1064 bytes} [Fri Aug 27 03:24:16 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:24:16.962803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d1299-1703-42e4-b116-d23d58983d6b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:16.974977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d1299-1703-42e4-b116-d23d58983d6b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:16.979529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a4f8e-2dfd-43c0-9912-e38137765995 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:16.980179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4f8e-2dfd-43c0-9912-e38137765995 service glance] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:16.980469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4f8e-2dfd-43c0-9912-e38137765995 service glance] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:16.980725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4f8e-2dfd-43c0-9912-e38137765995 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:16.990712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a4f8e-2dfd-43c0-9912-e38137765995 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:16.992160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a4f8e-2dfd-43c0-9912-e38137765995 service glance] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:17.002101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 707/1418] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:24:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:24:19.224657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3d4f-2eb1-4f21-a01b-b8bd21799b0e None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:19.225256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3d4f-2eb1-4f21-a01b-b8bd21799b0e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:19.225256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb3d4f-2eb1-4f21-a01b-b8bd21799b0e None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:19.227006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 712/1419] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:19.236564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5afa9c-0a2c-405d-93b8-fc7d34552566 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:19.236984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5afa9c-0a2c-405d-93b8-fc7d34552566 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:19.237122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5afa9c-0a2c-405d-93b8-fc7d34552566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:19.261772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8a5afa9c-0a2c-405d-93b8-fc7d34552566 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:19.262969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8a5afa9c-0a2c-405d-93b8-fc7d34552566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:19.271397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 708/1420] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:24:19.301399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb3d4f-2eb1-4f21-a01b-b8bd21799b0e None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:19.315462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb3d4f-2eb1-4f21-a01b-b8bd21799b0e None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:19.321083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17604f30-7f7e-4242-86e5-b38fdeecf791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:19.321752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17604f30-7f7e-4242-86e5-b38fdeecf791 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:19.322025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17604f30-7f7e-4242-86e5-b38fdeecf791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:19.322296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17604f30-7f7e-4242-86e5-b38fdeecf791 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:19.323019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17604f30-7f7e-4242-86e5-b38fdeecf791 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:19.324930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17604f30-7f7e-4242-86e5-b38fdeecf791 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:19.345428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 713/1421] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Aug 27 03:24:19 2021] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:24:21.531827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92872-1ff2-49db-9f34-56bdf060047e None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:21.532725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92872-1ff2-49db-9f34-56bdf060047e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:21.532725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd92872-1ff2-49db-9f34-56bdf060047e None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:21.535606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 709/1422] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:21.541771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984eb52-0087-4b77-8bca-b0f4e4a888e3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:21.542237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984eb52-0087-4b77-8bca-b0f4e4a888e3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:21.542341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984eb52-0087-4b77-8bca-b0f4e4a888e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:21.563196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b984eb52-0087-4b77-8bca-b0f4e4a888e3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:21.564432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b984eb52-0087-4b77-8bca-b0f4e4a888e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:21.573370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 714/1423] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:24:21.620936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92872-1ff2-49db-9f34-56bdf060047e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:21.640886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd92872-1ff2-49db-9f34-56bdf060047e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:21.650807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76f1fa-1e9a-4b7f-964d-2edd0320632c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:21.651817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f1fa-1e9a-4b7f-964d-2edd0320632c service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:21.652172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f1fa-1e9a-4b7f-964d-2edd0320632c service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:21.652448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76f1fa-1e9a-4b7f-964d-2edd0320632c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:21.664251 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76f1fa-1e9a-4b7f-964d-2edd0320632c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:21.665871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76f1fa-1e9a-4b7f-964d-2edd0320632c service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:21.675661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 710/1424] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:24:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:24:24.019154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515a9a-19e9-4c29-9de0-1157bbda31fd None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:24.019790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515a9a-19e9-4c29-9de0-1157bbda31fd None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:24.019790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515a9a-19e9-4c29-9de0-1157bbda31fd None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:24.021673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 715/1425] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:24.028833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a150-ca54-4d48-970c-1b03ea3c5dcd None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:24.029285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a150-ca54-4d48-970c-1b03ea3c5dcd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:24.029614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7a150-ca54-4d48-970c-1b03ea3c5dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:24.052838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-47d7a150-ca54-4d48-970c-1b03ea3c5dcd None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:24.054052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-47d7a150-ca54-4d48-970c-1b03ea3c5dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:24.062933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 711/1426] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:24:24.103079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d515a9a-19e9-4c29-9de0-1157bbda31fd None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:24.117563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d515a9a-19e9-4c29-9de0-1157bbda31fd None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:24.121280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739a28b-9dfb-417a-8155-a02e204eee65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:24.121913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739a28b-9dfb-417a-8155-a02e204eee65 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:24.122193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739a28b-9dfb-417a-8155-a02e204eee65 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:24.122462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739a28b-9dfb-417a-8155-a02e204eee65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:24.131558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739a28b-9dfb-417a-8155-a02e204eee65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:24.132990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739a28b-9dfb-417a-8155-a02e204eee65 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:24.142351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 716/1427] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:24:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:24:26.373076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8cc30-329d-416b-b5be-75d4047e70c5 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:26.373632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8cc30-329d-416b-b5be-75d4047e70c5 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:26.373632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8cc30-329d-416b-b5be-75d4047e70c5 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:26.375498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 712/1428] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:26.382899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513264-68e6-4304-a37f-1edd861cac1a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:26.383738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513264-68e6-4304-a37f-1edd861cac1a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:26.383948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513264-68e6-4304-a37f-1edd861cac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:26.407645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-44513264-68e6-4304-a37f-1edd861cac1a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:26.408887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-44513264-68e6-4304-a37f-1edd861cac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:26.417793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 717/1429] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:24:26.460516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8cc30-329d-416b-b5be-75d4047e70c5 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:26.472746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8cc30-329d-416b-b5be-75d4047e70c5 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:26.478404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f25da-bd5f-4dcd-9061-07100359b4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:26.479408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f25da-bd5f-4dcd-9061-07100359b4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:26.479787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f25da-bd5f-4dcd-9061-07100359b4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:26.480161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f25da-bd5f-4dcd-9061-07100359b4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:26.494493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f25da-bd5f-4dcd-9061-07100359b4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:26.495987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f25da-bd5f-4dcd-9061-07100359b4a5 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:26.505798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 713/1430] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:24:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:24:28.762327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01998d-42e4-4e02-b9ab-212bec81c090 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:28.763218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01998d-42e4-4e02-b9ab-212bec81c090 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:28.763218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01998d-42e4-4e02-b9ab-212bec81c090 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:28.766431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 718/1431] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:28.774835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5c3b-7bea-45e6-86dd-22b1ea7fba00 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:28.775266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5c3b-7bea-45e6-86dd-22b1ea7fba00 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:28.775403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5c3b-7bea-45e6-86dd-22b1ea7fba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:28.793736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b32f5c3b-7bea-45e6-86dd-22b1ea7fba00 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:28.794948 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b32f5c3b-7bea-45e6-86dd-22b1ea7fba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:28.803681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 714/1432] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:24:28.859077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01998d-42e4-4e02-b9ab-212bec81c090 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:28.871446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01998d-42e4-4e02-b9ab-212bec81c090 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:28.875266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a454d6-b100-471b-a7c0-4724f72133e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:28.875930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a454d6-b100-471b-a7c0-4724f72133e2 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:28.876207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a454d6-b100-471b-a7c0-4724f72133e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:28.876487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a454d6-b100-471b-a7c0-4724f72133e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:28.885902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a454d6-b100-471b-a7c0-4724f72133e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:28.887398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a454d6-b100-471b-a7c0-4724f72133e2 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:28.896815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 719/1433] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:24:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:24:31.283264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a7ec3-aab7-4fb6-8cca-95cab69cbb52 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:31.283850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a7ec3-aab7-4fb6-8cca-95cab69cbb52 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:31.283850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a7ec3-aab7-4fb6-8cca-95cab69cbb52 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:31.286630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 715/1434] 10.222.0.58 () {54 vars in 926 bytes} [Fri Aug 27 03:24:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:24:31.293780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492d6c-338d-4c7a-800f-961eaa3a19a2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:31.294206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492d6c-338d-4c7a-800f-961eaa3a19a2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:31.294389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca492d6c-338d-4c7a-800f-961eaa3a19a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:31.321902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ca492d6c-338d-4c7a-800f-961eaa3a19a2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:24:31.323113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ca492d6c-338d-4c7a-800f-961eaa3a19a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:24:31.332630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 720/1435] 10.222.0.58 () {58 vars in 1024 bytes} [Fri Aug 27 03:24:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:24:31.378723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a7ec3-aab7-4fb6-8cca-95cab69cbb52 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:24:31.391458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a7ec3-aab7-4fb6-8cca-95cab69cbb52 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:24:31.396906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201d84c-4ebf-4a57-b64f-753608f5055a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:24:31.397852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d84c-4ebf-4a57-b64f-753608f5055a service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:24:31.398250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d84c-4ebf-4a57-b64f-753608f5055a service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:24:31.398593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d84c-4ebf-4a57-b64f-753608f5055a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:24:31.410138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201d84c-4ebf-4a57-b64f-753608f5055a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:24:31.411764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201d84c-4ebf-4a57-b64f-753608f5055a service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:24:31.421446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 716/1436] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:24:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:41.223707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e221e-5ae0-48d5-9911-c03e869c537f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.224350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e221e-5ae0-48d5-9911-c03e869c537f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.224350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e221e-5ae0-48d5-9911-c03e869c537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.244010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c49e221e-5ae0-48d5-9911-c03e869c537f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:25:41.245185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c49e221e-5ae0-48d5-9911-c03e869c537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:25:41.253879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 721/1437] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:25:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:25:41.261913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94591bb-9781-4428-8613-0255b2151b6d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.262455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94591bb-9781-4428-8613-0255b2151b6d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.262455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94591bb-9781-4428-8613-0255b2151b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.282287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f94591bb-9781-4428-8613-0255b2151b6d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:25:41.283500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f94591bb-9781-4428-8613-0255b2151b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:25:41.297325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 717/1438] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:25:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:25:41.303319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e221e-5ae0-48d5-9911-c03e869c537f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:41.314650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e221e-5ae0-48d5-9911-c03e869c537f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:41.320499 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:41.321168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.321443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.321716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.322436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:25:41.322741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:41.324387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:41.336563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 722/1439] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:25:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:25:41.345163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94591bb-9781-4428-8613-0255b2151b6d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:41.357525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94591bb-9781-4428-8613-0255b2151b6d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:41.364930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:41.365592 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.365872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.366142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.366818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:41.368899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:41.407120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 718/1440] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:25:41 2021] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:25:41.411314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:41.421090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fad20c-fd4e-4ada-ab45-4a4f4ee3d027 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:41.479391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:41.479971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.480243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.480514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.481201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:41.483122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:41.504644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 723/1441] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:25:41 2021] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:25:41.509146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:41.520025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ed57-8124-40a9-92b1-b2823a570fa2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:41.524894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:41.525552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.525835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.526108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.526845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:41.528512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:41.542594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 719/1442] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:25:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:25:41.547502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:41.563781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5ec1d-e6cc-49fc-911e-b6233d01a460 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:41.571231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c7f04-d35a-4412-93d2-c746db3836ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:41.572316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7f04-d35a-4412-93d2-c746db3836ac admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.572764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7f04-d35a-4412-93d2-c746db3836ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.573192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7f04-d35a-4412-93d2-c746db3836ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.574340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c7f04-d35a-4412-93d2-c746db3836ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:41.576917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c7f04-d35a-4412-93d2-c746db3836ac admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:41.592900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 724/1443] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:25:41 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:25:41.598703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:41.609635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a70186-c307-4e9f-8cba-8ab0112a09ab admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:41.615604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:41.616501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.616781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.617054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] PATH_INFO: `/v3/projects/ea9d7e34a3884609ae080a0dcdabcff0/users/96fce4c8b1034b7e81f55b3f30cc2a15/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.634534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9d7e34a3884609ae080a0dcdabcff0, user_id=96fce4c8b1034b7e81f55b3f30cc2a15, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:41.637293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:41.656907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 720/1444] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:25:41 2021] PUT /identity/v3/projects/ea9d7e34a3884609ae080a0dcdabcff0/users/96fce4c8b1034b7e81f55b3f30cc2a15/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:25:41.670989 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd5ac6-9fba-4866-8189-e855d2d39f90 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.671276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd5ac6-9fba-4866-8189-e855d2d39f90 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.671668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd5ac6-9fba-4866-8189-e855d2d39f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.701252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-74dd5ac6-9fba-4866-8189-e855d2d39f90 None None] MFA Rules not processed for user `96fce4c8b1034b7e81f55b3f30cc2a15`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:25:41.703067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-74dd5ac6-9fba-4866-8189-e855d2d39f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:25:41.785575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 725/1445] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:25:41 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:25:41.797215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:41.872978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c15a-30ac-4609-9d91-f7b4f868e1ca admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:41.878910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:41.879602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.879882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.880152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.888153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:41.889735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:41.899146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 721/1446] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:25:41 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:41.982713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de890-bcd6-400c-b162-374027c5f83a None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:41.982997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de890-bcd6-400c-b162-374027c5f83a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:41.983328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de890-bcd6-400c-b162-374027c5f83a None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:41.985087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 726/1447] 10.222.0.58 () {52 vars in 829 bytes} [Fri Aug 27 03:25:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:25:41.988927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:42.050513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e544ec1-429a-45d5-b3b9-bb1aaa96e626 service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:42.057285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:42.058149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:42.058423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:42.058686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] PATH_INFO: `/v3/users/96fce4c8b1034b7e81f55b3f30cc2a15` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:42.060106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fce4c8b1034b7e81f55b3f30cc2a15)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:42.061153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:25:42.061153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:25:42.061153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:25:42.062344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:42.134140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fce4c8b1034b7e81f55b3f30cc2a15'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.146622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fce4c8b1034b7e81f55b3f30cc2a15'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.147607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fce4c8b1034b7e81f55b3f30cc2a15'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.167505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fce4c8b1034b7e81f55b3f30cc2a15'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.168304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fce4c8b1034b7e81f55b3f30cc2a15'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.186501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 722/1448] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:25:41 2021] DELETE /identity/v3/users/96fce4c8b1034b7e81f55b3f30cc2a15 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:25:42.191170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:42.191373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:42.191668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:42.210403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:25:42.211642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:25:42.268639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 727/1449] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:25:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:25:42.283750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:42.285872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:25:42.348936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7e55-2bf1-4552-bc30-2a6554dc81ac admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:42.353291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c480653-05d8-4dad-9d61-c5ba8c7c781d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:42.353967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480653-05d8-4dad-9d61-c5ba8c7c781d service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:42.354199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480653-05d8-4dad-9d61-c5ba8c7c781d service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:42.354513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c480653-05d8-4dad-9d61-c5ba8c7c781d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:42.364541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c480653-05d8-4dad-9d61-c5ba8c7c781d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:42.366008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c480653-05d8-4dad-9d61-c5ba8c7c781d service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:42.376990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 723/1450] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:25:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:25:42.732826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:25:42.734297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:25:42.746297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694d80-6d96-47b4-9893-c482d93f8184 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:25:42.751451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:25:42.752295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:25:42.752635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:25:42.752804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] PATH_INFO: `/v3/projects/ea9d7e34a3884609ae080a0dcdabcff0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:25:42.754285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9d7e34a3884609ae080a0dcdabcff0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:25:42.755285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:25:42.755285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:25:42.755285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:25:42.756433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:25:42.816053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9d7e34a3884609ae080a0dcdabcff0', 'request_id': 'req-de0370a5-fb89-4340-b4ae-dc490fd2c495'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.830545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9d7e34a3884609ae080a0dcdabcff0', 'request_id': 'req-de0370a5-fb89-4340-b4ae-dc490fd2c495'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.840867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9d7e34a3884609ae080a0dcdabcff0', 'request_id': 'req-de0370a5-fb89-4340-b4ae-dc490fd2c495'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.852370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] The token cache is being invalidate because project ea9d7e34a3884609ae080a0dcdabcff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:25:42.852623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.853319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-de0370a5-fb89-4340-b4ae-dc490fd2c495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:25:42.855060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 728/1451] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:25:42 2021] DELETE /identity/v3/projects/ea9d7e34a3884609ae080a0dcdabcff0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:27:17.558524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a4f2-3af6-4a78-a305-54ef5fcda7e1 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:17.559246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a4f2-3af6-4a78-a305-54ef5fcda7e1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:17.559246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3a4f2-3af6-4a78-a305-54ef5fcda7e1 None None] PATH_INFO: `/v3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:17.561131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 724/1452] 10.222.0.63 () {54 vars in 926 bytes} [Fri Aug 27 03:27:17 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:27:17.569696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897f34-390f-4a27-94d8-87644656357c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:17.570230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897f34-390f-4a27-94d8-87644656357c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:17.570230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897f34-390f-4a27-94d8-87644656357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:17.590443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ac897f34-390f-4a27-94d8-87644656357c None None] MFA Rules not processed for user `58838486fa5f49c4bca67ad01713fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:17.591730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ac897f34-390f-4a27-94d8-87644656357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:17.663409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 729/1453] 10.222.0.63 () {58 vars in 1016 bytes} [Fri Aug 27 03:27:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:17.934556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0c3cd-13e3-4c08-9404-7f20cfc6d800 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:17.934976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0c3cd-13e3-4c08-9404-7f20cfc6d800 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:17.935525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0c3cd-13e3-4c08-9404-7f20cfc6d800 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:17.938479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 725/1454] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 03:27:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:17.944721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2af72-125d-4d15-8760-6bdbf92ef244 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:17.945022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2af72-125d-4d15-8760-6bdbf92ef244 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:17.945299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2af72-125d-4d15-8760-6bdbf92ef244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:17.965607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-98e2af72-125d-4d15-8760-6bdbf92ef244 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:17.966812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-98e2af72-125d-4d15-8760-6bdbf92ef244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:18.031217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 730/1455] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 03:27:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:18.195618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0c3cd-13e3-4c08-9404-7f20cfc6d800 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:18.197427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f4c0c3cd-13e3-4c08-9404-7f20cfc6d800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:18.284338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0c3cd-13e3-4c08-9404-7f20cfc6d800 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:18.290493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796355-1b0a-4463-b627-b76df9ab8487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:18.291239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796355-1b0a-4463-b627-b76df9ab8487 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:18.291631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796355-1b0a-4463-b627-b76df9ab8487 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:18.291913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796355-1b0a-4463-b627-b76df9ab8487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:18.303136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796355-1b0a-4463-b627-b76df9ab8487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:18.305137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796355-1b0a-4463-b627-b76df9ab8487 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:18.317846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 726/1456] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:27:19.677240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1397c2-2ba9-4503-b2c2-2b43bd8aba99 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:19.677833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1397c2-2ba9-4503-b2c2-2b43bd8aba99 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:19.677833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1397c2-2ba9-4503-b2c2-2b43bd8aba99 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:19.679652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 731/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 03:27:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:27:19.685915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e92c1-67a6-4147-a4b2-655e027399a9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:19.686390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e92c1-67a6-4147-a4b2-655e027399a9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:19.686500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e92c1-67a6-4147-a4b2-655e027399a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:19.704781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-973e92c1-67a6-4147-a4b2-655e027399a9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:19.706097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-973e92c1-67a6-4147-a4b2-655e027399a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:19.714182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 727/1458] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 03:27:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:27:19.872117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1397c2-2ba9-4503-b2c2-2b43bd8aba99 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:19.890720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1397c2-2ba9-4503-b2c2-2b43bd8aba99 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:19.897211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab16dd-2537-4a66-813f-4eb6e62d9f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:19.897896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab16dd-2537-4a66-813f-4eb6e62d9f23 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:19.898178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab16dd-2537-4a66-813f-4eb6e62d9f23 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:19.898455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab16dd-2537-4a66-813f-4eb6e62d9f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:19.907833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab16dd-2537-4a66-813f-4eb6e62d9f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:19.909638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab16dd-2537-4a66-813f-4eb6e62d9f23 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:19.919198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 732/1459] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:27:21.325623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22057a-33d5-4e2b-a63b-21ad80b34610 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:21.326117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22057a-33d5-4e2b-a63b-21ad80b34610 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:21.326249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22057a-33d5-4e2b-a63b-21ad80b34610 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:21.328065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 728/1460] 10.222.0.58 () {54 vars in 960 bytes} [Fri Aug 27 03:27:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:21.334277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b890-2653-4561-95c2-10869aee01d4 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:21.334756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b890-2653-4561-95c2-10869aee01d4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:21.334876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b890-2653-4561-95c2-10869aee01d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:21.363673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7760b890-2653-4561-95c2-10869aee01d4 None None] MFA Rules not processed for user `58838486fa5f49c4bca67ad01713fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:21.364929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7760b890-2653-4561-95c2-10869aee01d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:21.374732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 733/1461] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Aug 27 03:27:21 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:21.384206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22057a-33d5-4e2b-a63b-21ad80b34610 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:21.398744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22057a-33d5-4e2b-a63b-21ad80b34610 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:21.404268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c51a-4e8d-4c83-9d13-9693b0c33c9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:21.404904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c51a-4e8d-4c83-9d13-9693b0c33c9b service placement] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:21.405178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c51a-4e8d-4c83-9d13-9693b0c33c9b service placement] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:21.405455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c51a-4e8d-4c83-9d13-9693b0c33c9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:21.414489 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c51a-4e8d-4c83-9d13-9693b0c33c9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:21.416164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c51a-4e8d-4c83-9d13-9693b0c33c9b service placement] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:21.425978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 729/1462] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:21 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:27:31.861807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c2f6-c8f6-460c-8fcd-99e39d2ef256 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:31.862395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c2f6-c8f6-460c-8fcd-99e39d2ef256 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:31.862395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c2f6-c8f6-460c-8fcd-99e39d2ef256 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:31.864540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 734/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 03:27:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:31.871150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f2af-5734-4c87-8bb8-02421d3dbbc3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:31.871937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f2af-5734-4c87-8bb8-02421d3dbbc3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:31.872116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f2af-5734-4c87-8bb8-02421d3dbbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:31.903377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-73c1f2af-5734-4c87-8bb8-02421d3dbbc3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:31.904661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-73c1f2af-5734-4c87-8bb8-02421d3dbbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:31.914732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 730/1464] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 03:27:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:32.074099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c2f6-c8f6-460c-8fcd-99e39d2ef256 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:32.093556 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c2f6-c8f6-460c-8fcd-99e39d2ef256 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:32.099779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2deb36-bb8e-42b0-82f4-62cab639a7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:32.100436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2deb36-bb8e-42b0-82f4-62cab639a7a3 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:32.100739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2deb36-bb8e-42b0-82f4-62cab639a7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:32.100996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2deb36-bb8e-42b0-82f4-62cab639a7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:32.109251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2deb36-bb8e-42b0-82f4-62cab639a7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:32.111018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2deb36-bb8e-42b0-82f4-62cab639a7a3 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:32.124609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 735/1465] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:27:33.498978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a62eb-f95f-4ab3-a8ba-519524e83395 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:33.499631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a62eb-f95f-4ab3-a8ba-519524e83395 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:33.499631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a62eb-f95f-4ab3-a8ba-519524e83395 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:33.501382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 731/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 27 03:27:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:33.508033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323754ef-92fa-4a39-8cfe-e1f8d5442e49 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:33.508806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323754ef-92fa-4a39-8cfe-e1f8d5442e49 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:33.508968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323754ef-92fa-4a39-8cfe-e1f8d5442e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:33.532976 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-323754ef-92fa-4a39-8cfe-e1f8d5442e49 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:33.534227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-323754ef-92fa-4a39-8cfe-e1f8d5442e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:33.544055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 736/1467] 127.0.0.1 () {58 vars in 999 bytes} [Fri Aug 27 03:27:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:33.701472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a62eb-f95f-4ab3-a8ba-519524e83395 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:33.719936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a62eb-f95f-4ab3-a8ba-519524e83395 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:33.727793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cbab8-3851-4323-8015-5a693fad1c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:33.728446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cbab8-3851-4323-8015-5a693fad1c07 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:33.728724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cbab8-3851-4323-8015-5a693fad1c07 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:33.728996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cbab8-3851-4323-8015-5a693fad1c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:33.738160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cbab8-3851-4323-8015-5a693fad1c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:33.739934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cbab8-3851-4323-8015-5a693fad1c07 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:33.749927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 732/1468] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:27:37.857420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71352a99-7301-4dee-8f46-30a2a5b9e9b4 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:37.858337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71352a99-7301-4dee-8f46-30a2a5b9e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:37.858485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71352a99-7301-4dee-8f46-30a2a5b9e9b4 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:37.862306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 737/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 03:27:37 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:37.868923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a109-343b-442d-811a-d67121424257 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:37.869399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a109-343b-442d-811a-d67121424257 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:37.869508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a109-343b-442d-811a-d67121424257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:37.887758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f184a109-343b-442d-811a-d67121424257 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:37.889003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f184a109-343b-442d-811a-d67121424257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:37.898449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 733/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 03:27:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:37.940262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71352a99-7301-4dee-8f46-30a2a5b9e9b4 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:37.943536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-71352a99-7301-4dee-8f46-30a2a5b9e9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:38.011569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71352a99-7301-4dee-8f46-30a2a5b9e9b4 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:38.015620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd352edf-5673-4ddf-99df-35f036751514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:38.016292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd352edf-5673-4ddf-99df-35f036751514 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:38.016571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd352edf-5673-4ddf-99df-35f036751514 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:38.016851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd352edf-5673-4ddf-99df-35f036751514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:38.033343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd352edf-5673-4ddf-99df-35f036751514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:38.034834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd352edf-5673-4ddf-99df-35f036751514 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:38.045201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 738/1471] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:27:40.214959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18867e9e-9450-4f80-bc69-788249bc3d5e None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:40.215597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18867e9e-9450-4f80-bc69-788249bc3d5e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:40.215597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18867e9e-9450-4f80-bc69-788249bc3d5e None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:40.217363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 734/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 03:27:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:40.224424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913fbc1-cbd5-4247-b5c2-92c836c1db65 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:40.225148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913fbc1-cbd5-4247-b5c2-92c836c1db65 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:40.225293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913fbc1-cbd5-4247-b5c2-92c836c1db65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:40.248441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1913fbc1-cbd5-4247-b5c2-92c836c1db65 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:40.249623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1913fbc1-cbd5-4247-b5c2-92c836c1db65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:40.258217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 739/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 03:27:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:40.299334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18867e9e-9450-4f80-bc69-788249bc3d5e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:40.313198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18867e9e-9450-4f80-bc69-788249bc3d5e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:40.317710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b886e-2524-4ea9-bb8b-a7cd1f11e010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:40.318363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b886e-2524-4ea9-bb8b-a7cd1f11e010 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:40.318676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b886e-2524-4ea9-bb8b-a7cd1f11e010 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:40.318937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b886e-2524-4ea9-bb8b-a7cd1f11e010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:40.328294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b886e-2524-4ea9-bb8b-a7cd1f11e010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:40.329754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b886e-2524-4ea9-bb8b-a7cd1f11e010 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:40.339730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 735/1474] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:27:44.150580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882a37-9ec7-4541-bdb9-d82956ec7cc9 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:44.151539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882a37-9ec7-4541-bdb9-d82956ec7cc9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:44.151539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882a37-9ec7-4541-bdb9-d82956ec7cc9 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:44.154497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 740/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 03:27:44 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:44.163295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b403-1053-4fbe-a2fe-1a69119f9db3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:44.163800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b403-1053-4fbe-a2fe-1a69119f9db3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:44.163909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b403-1053-4fbe-a2fe-1a69119f9db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:44.190293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c223b403-1053-4fbe-a2fe-1a69119f9db3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:44.191943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c223b403-1053-4fbe-a2fe-1a69119f9db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:44.201027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 736/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 03:27:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:27:44.257791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58882a37-9ec7-4541-bdb9-d82956ec7cc9 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:44.259663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-58882a37-9ec7-4541-bdb9-d82956ec7cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:44.325048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58882a37-9ec7-4541-bdb9-d82956ec7cc9 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:44.329213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8c2d0-3e60-4774-8dc3-ad3675456155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:44.329874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c2d0-3e60-4774-8dc3-ad3675456155 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:44.330160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c2d0-3e60-4774-8dc3-ad3675456155 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:44.330436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8c2d0-3e60-4774-8dc3-ad3675456155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:44.340302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8c2d0-3e60-4774-8dc3-ad3675456155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:44.341759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8c2d0-3e60-4774-8dc3-ad3675456155 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:44.351640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 741/1477] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:27:46.594005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438ade-31e8-42b1-b4e9-90a24d913e82 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:46.594764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438ade-31e8-42b1-b4e9-90a24d913e82 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:46.594764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438ade-31e8-42b1-b4e9-90a24d913e82 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:46.596596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 737/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Aug 27 03:27:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:46.607558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ec13b-2f7a-4688-8d02-f677d4d72937 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:46.607558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ec13b-2f7a-4688-8d02-f677d4d72937 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:46.607558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ec13b-2f7a-4688-8d02-f677d4d72937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:46.635754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7c8ec13b-2f7a-4688-8d02-f677d4d72937 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:46.637037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7c8ec13b-2f7a-4688-8d02-f677d4d72937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:46.647100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 742/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 27 03:27:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:46.711929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7788a8-8d5f-46c5-a8b1-8ed1f79fcb20 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:46.712293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7788a8-8d5f-46c5-a8b1-8ed1f79fcb20 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:46.712538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7788a8-8d5f-46c5-a8b1-8ed1f79fcb20 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:46.714360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 738/1480] 10.222.0.58 () {54 vars in 966 bytes} [Fri Aug 27 03:27:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:27:46.721466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dfccd-4821-40a9-91d2-224bac20222c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:46.721761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dfccd-4821-40a9-91d2-224bac20222c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:46.722036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dfccd-4821-40a9-91d2-224bac20222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:46.750675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3b2dfccd-4821-40a9-91d2-224bac20222c None None] MFA Rules not processed for user `d5d8aa6c0fa94ced8f7b277572b06dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:27:46.752372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3b2dfccd-4821-40a9-91d2-224bac20222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:27:46.761104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 743/1481] 10.222.0.58 () {58 vars in 1064 bytes} [Fri Aug 27 03:27:46 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:27:46.770676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7788a8-8d5f-46c5-a8b1-8ed1f79fcb20 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:27:46.789690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7788a8-8d5f-46c5-a8b1-8ed1f79fcb20 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:27:46.794421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761df4-22f3-44e5-9267-957208d8ab26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:27:46.795083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761df4-22f3-44e5-9267-957208d8ab26 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:27:46.795379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761df4-22f3-44e5-9267-957208d8ab26 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:27:46.795658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761df4-22f3-44e5-9267-957208d8ab26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:27:46.807342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da761df4-22f3-44e5-9267-957208d8ab26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:27:46.808858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da761df4-22f3-44e5-9267-957208d8ab26 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:27:46.819753 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 739/1482] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:27:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:08.816826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610982ce-9096-4e8a-9e0a-3e1b4d335591 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:08.817934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610982ce-9096-4e8a-9e0a-3e1b4d335591 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:08.818437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610982ce-9096-4e8a-9e0a-3e1b4d335591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:08.841496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-610982ce-9096-4e8a-9e0a-3e1b4d335591 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:08.843086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-610982ce-9096-4e8a-9e0a-3e1b4d335591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:08.858122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 744/1483] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:08.867143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac08b-3578-48cb-ace3-63d6d0e0b36f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:08.868163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac08b-3578-48cb-ace3-63d6d0e0b36f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:08.868656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ac08b-3578-48cb-ace3-63d6d0e0b36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:08.891494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-9f7ac08b-3578-48cb-ace3-63d6d0e0b36f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:08.893210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9f7ac08b-3578-48cb-ace3-63d6d0e0b36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:08.906221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 740/1484] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:08.911127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610982ce-9096-4e8a-9e0a-3e1b4d335591 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:08.921665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610982ce-9096-4e8a-9e0a-3e1b4d335591 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:08.928005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:08.929088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:08.929587 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:08.930447 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:08.931489 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:08.932018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:08.932541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3aa9-d7c9-41f7-a156-c67c80b88e11 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:08.933083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3aa9-d7c9-41f7-a156-c67c80b88e11 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:08.933712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3aa9-d7c9-41f7-a156-c67c80b88e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:08.933835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:08.950354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 745/1485] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:08.958185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:08.972327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d5455-0a6e-4c7b-b29a-9470e549a47c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:08.977115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:08.977879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:08.978169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:08.978456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:08.979155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:08.982846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:08.985197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-042a3aa9-d7c9-41f7-a156-c67c80b88e11 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:08.986625 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-042a3aa9-d7c9-41f7-a156-c67c80b88e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.005498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 741/1486] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 03:29:09.015768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebddc9-bcba-4643-9ff5-fade132ecde8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.016429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebddc9-bcba-4643-9ff5-fade132ecde8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.016922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebddc9-bcba-4643-9ff5-fade132ecde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.025032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 746/1487] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:08 2021] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:09.029485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.050277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5eebddc9-bcba-4643-9ff5-fade132ecde8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.051904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5eebddc9-bcba-4643-9ff5-fade132ecde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.127658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 742/1488] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:09.130188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3120107-449c-4274-9e3c-fe428759926b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.131982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d467f-1238-4538-bd59-e68cd5e9be21 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.132322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d467f-1238-4538-bd59-e68cd5e9be21 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.132598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d467f-1238-4538-bd59-e68cd5e9be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.141570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.142257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.142536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.142814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.145236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.147169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.165817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-e74d467f-1238-4538-bd59-e68cd5e9be21 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.168211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e74d467f-1238-4538-bd59-e68cd5e9be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.187250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 743/1489] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.188722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143d11-1f97-4828-9c37-f479707216a3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.189019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143d11-1f97-4828-9c37-f479707216a3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.189295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143d11-1f97-4828-9c37-f479707216a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.190714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 747/1490] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:09.191576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.204709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbfbc1-2f41-4cec-a480-330b0ad33e73 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.208548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3e143d11-1f97-4828-9c37-f479707216a3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.209950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0dd74-d68a-4c18-93e4-1447aed67e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.210609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3e143d11-1f97-4828-9c37-f479707216a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.210711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0dd74-d68a-4c18-93e4-1447aed67e78 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.210711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0dd74-d68a-4c18-93e4-1447aed67e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.211026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0dd74-d68a-4c18-93e4-1447aed67e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.211936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0dd74-d68a-4c18-93e4-1447aed67e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:09.212363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0dd74-d68a-4c18-93e4-1447aed67e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.214124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0dd74-d68a-4c18-93e4-1447aed67e78 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.220421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 744/1491] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.221536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001b7fd-e80b-47b8-b286-e907324f536f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.221821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001b7fd-e80b-47b8-b286-e907324f536f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.222094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001b7fd-e80b-47b8-b286-e907324f536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.231264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 748/1492] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:09.236805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec2a3a-78aa-4a2e-b60d-d45eaf9d1893 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.237177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec2a3a-78aa-4a2e-b60d-d45eaf9d1893 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.237433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec2a3a-78aa-4a2e-b60d-d45eaf9d1893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.241268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0001b7fd-e80b-47b8-b286-e907324f536f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.242519 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0001b7fd-e80b-47b8-b286-e907324f536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.250583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 745/1493] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.251499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001b7fd-e80b-47b8-b286-e907324f536f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.256447 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d8ec2a3a-78aa-4a2e-b60d-d45eaf9d1893 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.257729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d8ec2a3a-78aa-4a2e-b60d-d45eaf9d1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.260990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001b7fd-e80b-47b8-b286-e907324f536f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.265898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 749/1494] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.266015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb2150-1dd7-4aeb-a282-4a329fa7fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.266679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2150-1dd7-4aeb-a282-4a329fa7fb43 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.266961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2150-1dd7-4aeb-a282-4a329fa7fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.267230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873142-a5bb-439f-b83e-ad306de8339b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.267330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb2150-1dd7-4aeb-a282-4a329fa7fb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.267599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873142-a5bb-439f-b83e-ad306de8339b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.267850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873142-a5bb-439f-b83e-ad306de8339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.268018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2150-1dd7-4aeb-a282-4a329fa7fb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.269635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb2150-1dd7-4aeb-a282-4a329fa7fb43 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.279942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 746/1495] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:09.281179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04774b-41de-4320-8024-caa33d99faa6 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.281457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04774b-41de-4320-8024-caa33d99faa6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.281734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04774b-41de-4320-8024-caa33d99faa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.286728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-40873142-a5bb-439f-b83e-ad306de8339b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.288298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-40873142-a5bb-439f-b83e-ad306de8339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.297050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 750/1496] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.298478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8708c37-12cb-4940-9131-ff23733f2c5a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.298766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8708c37-12cb-4940-9131-ff23733f2c5a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.299045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8708c37-12cb-4940-9131-ff23733f2c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.299185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-9c04774b-41de-4320-8024-caa33d99faa6 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.300407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9c04774b-41de-4320-8024-caa33d99faa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.308736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 747/1497] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.309971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6013-7860-4a66-b239-82a361d49d9c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.310254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6013-7860-4a66-b239-82a361d49d9c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.310524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b6013-7860-4a66-b239-82a361d49d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.317618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d8708c37-12cb-4940-9131-ff23733f2c5a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.318815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d8708c37-12cb-4940-9131-ff23733f2c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.327150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 751/1498] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.328308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-907b6013-7860-4a66-b239-82a361d49d9c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.329469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-907b6013-7860-4a66-b239-82a361d49d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.330382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8708c37-12cb-4940-9131-ff23733f2c5a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.337938 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 748/1499] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.339176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328cb9b-8ca5-4f27-b8eb-85d6884765b8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.339493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328cb9b-8ca5-4f27-b8eb-85d6884765b8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.339773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328cb9b-8ca5-4f27-b8eb-85d6884765b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.340225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8708c37-12cb-4940-9131-ff23733f2c5a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.345044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.345503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.345764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.346036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.346746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.348695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.358636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-9328cb9b-8ca5-4f27-b8eb-85d6884765b8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.359857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9328cb9b-8ca5-4f27-b8eb-85d6884765b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.369814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 749/1500] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.371139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359fc21-004b-4836-bc52-bd5f6569581c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.372233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359fc21-004b-4836-bc52-bd5f6569581c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.372233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359fc21-004b-4836-bc52-bd5f6569581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.378460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 752/1501] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:09.379229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.394496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2359fc21-004b-4836-bc52-bd5f6569581c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.396066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2359fc21-004b-4836-bc52-bd5f6569581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.449735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9562d-5a13-467b-bba0-493a1b533718 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.454629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9af639-a57d-42d9-b280-6515d120f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.458685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af639-a57d-42d9-b280-6515d120f008 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.458685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af639-a57d-42d9-b280-6515d120f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.458685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af639-a57d-42d9-b280-6515d120f008 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.458685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9af639-a57d-42d9-b280-6515d120f008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.458685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9af639-a57d-42d9-b280-6515d120f008 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.467597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 750/1502] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.471517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 753/1503] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:09.471697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359fc21-004b-4836-bc52-bd5f6569581c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.471814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e0a6-4585-49ef-8a50-6a97f7865d7f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.471814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e0a6-4585-49ef-8a50-6a97f7865d7f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.471814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e0a6-4585-49ef-8a50-6a97f7865d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.482399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359fc21-004b-4836-bc52-bd5f6569581c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.488484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a83942-68b4-4290-bdd0-dae807a3086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.489020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-4054e0a6-4585-49ef-8a50-6a97f7865d7f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.489173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83942-68b4-4290-bdd0-dae807a3086b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.489408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83942-68b4-4290-bdd0-dae807a3086b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.489676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83942-68b4-4290-bdd0-dae807a3086b admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.490226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4054e0a6-4585-49ef-8a50-6a97f7865d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.490384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a83942-68b4-4290-bdd0-dae807a3086b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:09.490689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a83942-68b4-4290-bdd0-dae807a3086b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.492361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a83942-68b4-4290-bdd0-dae807a3086b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.498451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 754/1504] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.499264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e0a6-4585-49ef-8a50-6a97f7865d7f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.504622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 751/1505] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:09.506170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867ef54-c46d-44f9-9e5a-79b2af8f22b6 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.506613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867ef54-c46d-44f9-9e5a-79b2af8f22b6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.507062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867ef54-c46d-44f9-9e5a-79b2af8f22b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.509495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e0a6-4585-49ef-8a50-6a97f7865d7f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.514963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.515683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.515965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.516235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.516965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:09.517271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.518913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.525146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d867ef54-c46d-44f9-9e5a-79b2af8f22b6 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.526349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d867ef54-c46d-44f9-9e5a-79b2af8f22b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:09.538257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 755/1506] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:09.538257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.541727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 752/1507] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:09.542724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867ef54-c46d-44f9-9e5a-79b2af8f22b6 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.544044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d21e-a2f2-4345-ae51-6f73af9cd8a6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.549306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.549956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.550239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.550510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.551238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:09.551580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.552193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867ef54-c46d-44f9-9e5a-79b2af8f22b6 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.553177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.557520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.558170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.558447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.558718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.559424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.561339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.566182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 756/1508] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:09.567056 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.578866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c59f9f-5a79-49b0-aa67-bd672d472dae admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.583703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.584195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 753/1509] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:09.587533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.587533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.587533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.587811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.587903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:09.587903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.588497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.594359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7dd24-742e-4c80-b5da-0a50aa9bb8fb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.599617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.600591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 757/1510] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:09.600721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.600721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.601017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] PATH_INFO: `/v3/projects/e9d6a5b656034075ab6587199d369ecb/users/38b4144ff3f14c24be2c22a657b470ac/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.601209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.610759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355a0d2-074d-4eec-949c-22ba03d5b38c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.616242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.616509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d6a5b656034075ab6587199d369ecb, user_id=38b4144ff3f14c24be2c22a657b470ac, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.616900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.617200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.617494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.618210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:09.618510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.619319 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.620151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.640604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 754/1512] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:09 2021] PUT /identity/v3/projects/e9d6a5b656034075ab6587199d369ecb/users/38b4144ff3f14c24be2c22a657b470ac/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:09.640804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 758/1512] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:09.640804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.640994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.651948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd860d5b-82d1-45bc-ac8c-5061330611d7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.698394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017d500-5a01-4403-9f67-7140b6895b61 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.703053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.703790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.704138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.704412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.705131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.706513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.707068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.707231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.707488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.707768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.708426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.710329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.735401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 755/1513] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:09.735401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.736297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 759/1514] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:09.737098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.794462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81937f-288b-4677-a198-73725933cccc admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.799243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.799936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.800173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e621840-f6ca-4dd4-aa4d-9e2c3c378a49 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.800293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.800479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.801217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:09.801659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.803283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.805625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.806278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.806554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.806823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.807545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.809418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.817412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 756/1515] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:09.818425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.830096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2239648-2a79-42db-8d53-0e538c406304 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.835404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 760/1516] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:09.835884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.836952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.837096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.837096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.837096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.837829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.839577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.853391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 757/1517] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:09.853391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.862297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed362d-c8b8-4abb-a9c7-78e666e5eea8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.896642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd841a8-114f-4eee-955c-227c8216d5fa admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:09.901364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e772f-5c90-4be7-afa4-93400d0e9f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.902030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e772f-5c90-4be7-afa4-93400d0e9f6b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.902315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e772f-5c90-4be7-afa4-93400d0e9f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.902593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e772f-5c90-4be7-afa4-93400d0e9f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.903280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e772f-5c90-4be7-afa4-93400d0e9f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.905230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e772f-5c90-4be7-afa4-93400d0e9f6b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.917088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:09.917752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.918036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.918310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.919033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:09.921137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:09.932282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 761/1518] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:09.933714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519132-77ef-4de4-9d35-a5312e8b09cd None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:09.934170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519132-77ef-4de4-9d35-a5312e8b09cd None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:09.934507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519132-77ef-4de4-9d35-a5312e8b09cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:09.951018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 758/1519] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:09.951018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:09.961246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0c519132-77ef-4de4-9d35-a5312e8b09cd None None] MFA Rules not processed for user `38b4144ff3f14c24be2c22a657b470ac`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:09.962591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0c519132-77ef-4de4-9d35-a5312e8b09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:10.013120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db298-9c6d-48a0-9fd4-a0bbbd4a3541 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.018044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.018715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.018997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.019277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.019997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.021936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.029456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 762/1520] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:10.030292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519132-77ef-4de4-9d35-a5312e8b09cd None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.043682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519132-77ef-4de4-9d35-a5312e8b09cd None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.047775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 759/1521] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:09 2021] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:10.048584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.049507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.050183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.050453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.050721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.051651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.053556 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.058652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99917b-088c-4f27-aaca-90337f5aa006 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.063635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.064256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.064524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.064799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.065510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.067959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.078008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 763/1522] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:10.078008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.085605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71fa5e-d95f-4bfa-aea9-a140e2b2af33 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.091420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.092109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.092388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.092664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.093357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.094732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 760/1523] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:10.098206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.098336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.118804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 764/1524] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:10.118804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.126134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa542c-08ba-4b7d-a85f-65f9849e3700 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.163244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1cf37-5481-4819-87ac-d36e2cc0aa27 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.168795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.169466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.169754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.170030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.170766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.172428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.182159 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8150c84-348b-4e3c-823c-37f0ee09d3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.182830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150c84-348b-4e3c-823c-37f0ee09d3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.186053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 761/1525] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.186179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150c84-348b-4e3c-823c-37f0ee09d3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.186179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8150c84-348b-4e3c-823c-37f0ee09d3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.186462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.186562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8150c84-348b-4e3c-823c-37f0ee09d3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.186562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8150c84-348b-4e3c-823c-37f0ee09d3e0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.193244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5175c-c1f6-41c7-b956-d414a8cf54a6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.198886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.199750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.200066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.200322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.201177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.203109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.207203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 765/1526] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:10.208504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935baa0-80ef-4a9a-aaf0-ba4f8e6e2e45 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.208909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935baa0-80ef-4a9a-aaf0-ba4f8e6e2e45 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.209187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935baa0-80ef-4a9a-aaf0-ba4f8e6e2e45 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.211298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 766/1527] 10.222.0.58 () {54 vars in 961 bytes} [Fri Aug 27 03:29:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:10.212130 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935baa0-80ef-4a9a-aaf0-ba4f8e6e2e45 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.225671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 762/1528] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:10.226582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.226892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935baa0-80ef-4a9a-aaf0-ba4f8e6e2e45 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.232014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.232674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.232953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.233225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.233959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.235585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.236703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806f8c6-7e3e-45a2-bdeb-a983b9e399e7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.241732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.242735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.243151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.243395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.244136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.245794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.246020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 767/1529] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.249968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.257504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 763/1530] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.258883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.260325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacdeba-905d-4223-a967-e383fa385cdd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.265570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.266239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.266521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.266797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.267526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.268449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a524cc-de56-4c64-abf0-153eaa9839a5 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.269447 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.272993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.273714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.274215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.274520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.275233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.276834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.287602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 764/1531] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.288437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.292254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 768/1532] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:10.293221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.300851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0653-a78f-4e7a-bef6-4ed6ecc7678e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.302601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb834ee-d656-4aef-bf59-111f5fdbec9f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.306075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.307215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.307585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.307924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] PATH_INFO: `/v3/projects/f60ccdbc7dbb46c6abacc312e57220a1/users/75cb79bac8944976a2689f62b8d014e2/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.308030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b123c9-c1aa-4d54-ac97-cda0c3136858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.308614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b123c9-c1aa-4d54-ac97-cda0c3136858 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.308901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b123c9-c1aa-4d54-ac97-cda0c3136858 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.309175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b123c9-c1aa-4d54-ac97-cda0c3136858 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.309916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b123c9-c1aa-4d54-ac97-cda0c3136858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.311757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b123c9-c1aa-4d54-ac97-cda0c3136858 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.321861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 769/1533] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.323246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1106d39-e689-4f0c-80ad-36605ed6db7b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.323558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1106d39-e689-4f0c-80ad-36605ed6db7b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.323835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1106d39-e689-4f0c-80ad-36605ed6db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.323946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60ccdbc7dbb46c6abacc312e57220a1, user_id=75cb79bac8944976a2689f62b8d014e2, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.326690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.340667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 765/1534] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:10 2021] PUT /identity/v3/projects/f60ccdbc7dbb46c6abacc312e57220a1/users/75cb79bac8944976a2689f62b8d014e2/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:10.341542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.341955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d1106d39-e689-4f0c-80ad-36605ed6db7b None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:10.343153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d1106d39-e689-4f0c-80ad-36605ed6db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:10.402444 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbc03e-3c3a-4cbd-9852-13109443f926 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.407992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.409237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.409237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.409237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.409872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.410506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 770/1535] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:10.411571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.411688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1106d39-e689-4f0c-80ad-36605ed6db7b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.422395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1106d39-e689-4f0c-80ad-36605ed6db7b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.423091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 766/1536] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.424077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.429747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.430971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.431245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.431551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.432344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.433942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.434056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1944a-82a9-43ea-8e83-050e6e7939d2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.438693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.439338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.439655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.439931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.440648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.442226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.447611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 771/1537] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.447611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.456389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 767/1538] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.456389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.456657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e6c7b-3b56-4e41-8f9d-2bd6fb4c0ee2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.460532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.461295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.461584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.461860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.462602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.463822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3da2f-cad7-4bee-ae80-34cd1a0aff30 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.464266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.468798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac90fa4-b971-4fdb-aefa-02eccde8e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.469481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90fa4-b971-4fdb-aefa-02eccde8e766 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.469766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90fa4-b971-4fdb-aefa-02eccde8e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.470031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac90fa4-b971-4fdb-aefa-02eccde8e766 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.470753 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac90fa4-b971-4fdb-aefa-02eccde8e766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.472363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac90fa4-b971-4fdb-aefa-02eccde8e766 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.474717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 772/1539] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.478868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.482692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 768/1540] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.484130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2690c8-9200-4985-a3c7-357321ebe99f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.484417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2690c8-9200-4985-a3c7-357321ebe99f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.484690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2690c8-9200-4985-a3c7-357321ebe99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.490785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9b06-b48c-4b37-be6f-c1cb5613c023 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.495669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.496330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.496637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.496944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.497668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.499266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.501939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ae2690c8-9200-4985-a3c7-357321ebe99f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:10.503134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ae2690c8-9200-4985-a3c7-357321ebe99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:10.510027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 773/1541] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.510956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 769/1542] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:10.511623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2690c8-9200-4985-a3c7-357321ebe99f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.512464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.523396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2690c8-9200-4985-a3c7-357321ebe99f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.525318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945faf52-5a72-4eb0-bbad-8bec9c32923d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.528076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.528738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.529025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.529296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.530011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.530904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.531567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.531666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.531849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.532123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.541639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 770/1543] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.542407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.551585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718a189-2668-491e-9aa7-c93f6809f613 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.556672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.557536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.557826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.558095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] PATH_INFO: `/v3/projects/527dc9638ff74cfda148b7cf1b61c6c8/users/5c8979c080c54e9096de897a22ba40b3/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.572980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=527dc9638ff74cfda148b7cf1b61c6c8, user_id=5c8979c080c54e9096de897a22ba40b3, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.575658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.584319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.586036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.589971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 771/1544] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:10 2021] PUT /identity/v3/projects/527dc9638ff74cfda148b7cf1b61c6c8/users/5c8979c080c54e9096de897a22ba40b3/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:10.590820 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.598387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 774/1545] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:10.599316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.608947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c75251-d1bc-421e-96ae-ac212d29d17b service nova] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.651809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f28f89-ad6f-408e-b36a-dc488a6edd6b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.657634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.658622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.658974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.659326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] PATH_INFO: `/v3/projects/dba5a01bf20b47e4a67299b2f5aa032b/users/b514a1dc3cc642f2b83ba52eb39b4420/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.666385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.667298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.667616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.667894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] PATH_INFO: `/v3/projects/87a447abed3746a988777d61ceb08cf5/users/37911cd6ec7540b990400630cf4a9a23/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.675306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba5a01bf20b47e4a67299b2f5aa032b, user_id=b514a1dc3cc642f2b83ba52eb39b4420, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.678120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.685326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a447abed3746a988777d61ceb08cf5, user_id=37911cd6ec7540b990400630cf4a9a23, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.688492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.692583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 772/1546] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:10 2021] PUT /identity/v3/projects/dba5a01bf20b47e4a67299b2f5aa032b/users/b514a1dc3cc642f2b83ba52eb39b4420/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:10.693535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.703760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 775/1547] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:10 2021] PUT /identity/v3/projects/87a447abed3746a988777d61ceb08cf5/users/37911cd6ec7540b990400630cf4a9a23/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:10.708187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.762025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536edaa-cd96-4ec9-a54d-b34f96939638 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.781786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c64047-adc2-4802-a312-19c0d01592bb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.787389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.788673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.789287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.789835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] PATH_INFO: `/v3/projects/fc0a4b80aa5f45e0969ed7ba3c559e31/users/4f728e6c51da49f2a55d54ea67f265d0/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.814165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0a4b80aa5f45e0969ed7ba3c559e31, user_id=4f728e6c51da49f2a55d54ea67f265d0, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.816843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.823134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.824125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.824430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.824798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.825541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.827204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.843785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 776/1548] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:10 2021] PUT /identity/v3/projects/fc0a4b80aa5f45e0969ed7ba3c559e31/users/4f728e6c51da49f2a55d54ea67f265d0/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:10.843785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.849275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 773/1549] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:10.850279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:10.860249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efbc4d-d745-4dd5-87e8-f6d622d2c218 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.887534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2776d-7c7d-44dc-80e2-066f974c90e8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:10.891527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d422a-d774-46ab-878f-93018e7d3a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.892196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d422a-d774-46ab-878f-93018e7d3a00 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.892476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d422a-d774-46ab-878f-93018e7d3a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.892744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d422a-d774-46ab-878f-93018e7d3a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.916218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4773ed-7bab-4d97-b60f-38740597bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:10.917119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4773ed-7bab-4d97-b60f-38740597bf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.917707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4773ed-7bab-4d97-b60f-38740597bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.917790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4773ed-7bab-4d97-b60f-38740597bf5b admin admin] PATH_INFO: `/v3/projects/4ad9a3dc64ba489d9e9f1393ebab84ca/users/f2916b1a2b9f47b1bc82e21cfe352ccc/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.932793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4773ed-7bab-4d97-b60f-38740597bf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad9a3dc64ba489d9e9f1393ebab84ca, user_id=f2916b1a2b9f47b1bc82e21cfe352ccc, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.935467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4773ed-7bab-4d97-b60f-38740597bf5b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.948961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 774/1550] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:10 2021] PUT /identity/v3/projects/4ad9a3dc64ba489d9e9f1393ebab84ca/users/f2916b1a2b9f47b1bc82e21cfe352ccc/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:10.950334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2017-258a-4435-8580-3df397a4cc42 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.950609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2017-258a-4435-8580-3df397a4cc42 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.950874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2017-258a-4435-8580-3df397a4cc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.955293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d422a-d774-46ab-878f-93018e7d3a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:10.957067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d422a-d774-46ab-878f-93018e7d3a00 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:10.967410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7eed2017-258a-4435-8580-3df397a4cc42 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:10.967738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 777/1551] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:10.968684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7eed2017-258a-4435-8580-3df397a4cc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:10.969071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d24a1c-c122-49b3-bf2f-c51fbc357760 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:10.969362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d24a1c-c122-49b3-bf2f-c51fbc357760 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:10.969672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d24a1c-c122-49b3-bf2f-c51fbc357760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:10.987232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-35d24a1c-c122-49b3-bf2f-c51fbc357760 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:10.988530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-35d24a1c-c122-49b3-bf2f-c51fbc357760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:11.028124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 775/1552] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:11.029725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0707-5e63-464c-bd08-ffd40b2d82e2 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.029971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0707-5e63-464c-bd08-ffd40b2d82e2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.030256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0707-5e63-464c-bd08-ffd40b2d82e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.060282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 778/1553] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:11.061887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cbb11-cf49-473a-96c3-059724d2db12 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.062242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cbb11-cf49-473a-96c3-059724d2db12 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.062616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cbb11-cf49-473a-96c3-059724d2db12 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.067175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-922e0707-5e63-464c-bd08-ffd40b2d82e2 None None] MFA Rules not processed for user `37911cd6ec7540b990400630cf4a9a23`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:11.068582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-922e0707-5e63-464c-bd08-ffd40b2d82e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:11.069658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 779/1554] 10.222.0.58 () {54 vars in 912 bytes} [Fri Aug 27 03:29:11 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:11.071304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5db8-e4bf-4919-9659-05120c53622b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.071675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5db8-e4bf-4919-9659-05120c53622b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.071904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5db8-e4bf-4919-9659-05120c53622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.104605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-989a5db8-e4bf-4919-9659-05120c53622b None None] MFA Rules not processed for user `4f728e6c51da49f2a55d54ea67f265d0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:11.106263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-989a5db8-e4bf-4919-9659-05120c53622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:11.148333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 776/1555] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:11.149787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0707-5e63-464c-bd08-ffd40b2d82e2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.163120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0707-5e63-464c-bd08-ffd40b2d82e2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.169281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.170584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.170992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.171429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] PATH_INFO: `/v3/projects/01d740e2fdbb43f696818d258b9b3f4d/users/b0959c5e5b1c49a9b5395f90360ce934/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.185150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 780/1556] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:11.185150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444ac3-f3d0-4419-89e5-368934f8ad41 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.185150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444ac3-f3d0-4419-89e5-368934f8ad41 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.185150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10444ac3-f3d0-4419-89e5-368934f8ad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.202970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d740e2fdbb43f696818d258b9b3f4d, user_id=b0959c5e5b1c49a9b5395f90360ce934, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.205796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.215534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-10444ac3-f3d0-4419-89e5-368934f8ad41 None None] MFA Rules not processed for user `f2916b1a2b9f47b1bc82e21cfe352ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:11.217141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-10444ac3-f3d0-4419-89e5-368934f8ad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:11.220096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 777/1557] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:11 2021] PUT /identity/v3/projects/01d740e2fdbb43f696818d258b9b3f4d/users/b0959c5e5b1c49a9b5395f90360ce934/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:11.221327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.222847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:11.281845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516b63-d02f-415e-b0ed-aacb623f576d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.285638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.286541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 781/1558] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:11.286678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.286848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.287213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.287953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb83d4-cee2-44a2-b2ee-415bbc8ece6f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.288169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb83d4-cee2-44a2-b2ee-415bbc8ece6f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.288449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb83d4-cee2-44a2-b2ee-415bbc8ece6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.308193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-37bb83d4-cee2-44a2-b2ee-415bbc8ece6f None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:11.309665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-37bb83d4-cee2-44a2-b2ee-415bbc8ece6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:11.359205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.361086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.377801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 778/1559] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:11.378706 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.388220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 782/1560] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:11.388748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd25a6-8954-433d-9aea-a6fa1c0b4ede service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.393731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.393731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.394005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.394178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.394893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb83d4-cee2-44a2-b2ee-415bbc8ece6f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.404721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.405486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb83d4-cee2-44a2-b2ee-415bbc8ece6f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.406181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.410503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdedf5-8956-4394-b778-25339613b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.411236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdedf5-8956-4394-b778-25339613b7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.411619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdedf5-8956-4394-b778-25339613b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.411972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdedf5-8956-4394-b778-25339613b7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.412811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdedf5-8956-4394-b778-25339613b7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.415647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdedf5-8956-4394-b778-25339613b7d9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.418800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 779/1561] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:11.419782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.446899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 783/1562] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:11.449193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33dc38-5447-4a04-8386-9f8af35df0de None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.449630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33dc38-5447-4a04-8386-9f8af35df0de None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.449947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33dc38-5447-4a04-8386-9f8af35df0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.476536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-2e33dc38-5447-4a04-8386-9f8af35df0de None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:11.478199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2e33dc38-5447-4a04-8386-9f8af35df0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:11.496259 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7d0e-cbb4-4310-b20d-f7d64812c701 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.548667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 784/1563] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:11.551928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33dc38-5447-4a04-8386-9f8af35df0de None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.557989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.558455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.558737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.559010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.559728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33dc38-5447-4a04-8386-9f8af35df0de None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.564594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.565180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.565505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.565763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.566432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.568714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.600694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 785/1564] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:11.600694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.618317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.619854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.629211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 780/1565] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:11 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:11.632416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.645102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd587b-03fa-48bd-bd7b-5f714a9834f3 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.664413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854558df-ad38-4fe7-9efd-d75df2388999 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.668513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.669284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.669663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.670046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.711382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.712537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.712827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.713290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.714101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.716313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.745368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 781/1566] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:11.746736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.778158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.780536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.811620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 786/1567] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:11.816421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.834266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d43b5-8fd5-4556-b03d-858ac50a6d2a service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.840062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.840805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.841084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.841354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.842052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.844103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.859711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b977712-df37-4d0a-b4ad-c12afa42c3b3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.864253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.865265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.865650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.866364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.885779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 787/1568] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:11 2021] POST /identity/v3/users => generated 296 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:11.886854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.905853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.912662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.913315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6032fb-9f0b-4971-9c52-1574f31f4fb6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.925347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.926692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.927028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:11.928949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:11.931126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:11.935542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:11.948554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 782/1569] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:11.950512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.965804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 788/1570] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:11 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:11.970502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:11.984072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cf15d-06b3-4fae-bb49-8126d7d7ca19 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.988119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd0445-9aa1-4541-aae8-2138f1434f05 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:11.998022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:11.998880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:11.999283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.000285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.002143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.008012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.008900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.009049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.009188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.009459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] PATH_INFO: `/v3/projects/e549f2f0c0074d5f9464d423b33995f1/users/e9c0f9f48e3c49cb9aaa2e87e058cd7e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.028064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e549f2f0c0074d5f9464d423b33995f1, user_id=e9c0f9f48e3c49cb9aaa2e87e058cd7e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.032339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.039426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 783/1571] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:11 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:12.047206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:12.054815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 789/1572] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:11 2021] PUT /identity/v3/projects/e549f2f0c0074d5f9464d423b33995f1/users/e9c0f9f48e3c49cb9aaa2e87e058cd7e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:12.060005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:12.082695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983a2e-e4e7-4613-a335-3ba75af74b31 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:12.138995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccc231-7193-47ad-b488-d17835101586 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:12.146060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.149094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.149937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.150291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.152855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.160112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.185084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 790/1573] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:12.193804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:12.219588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f404378-2783-40f9-9b12-d8b6cad06785 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:12.225535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.226854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.227309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.227707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] PATH_INFO: `/v3/projects/f3f53de5d3fb4b6db4a8d6037dadd242/users/73e4a12724f24821b9b5f9215d145e25/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.230316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcda1f-6b9f-4672-aeb7-3682922d10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.233617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcda1f-6b9f-4672-aeb7-3682922d10e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.236056 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcda1f-6b9f-4672-aeb7-3682922d10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.237021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcda1f-6b9f-4672-aeb7-3682922d10e1 admin admin] PATH_INFO: `/v3/projects/e549f2f0c0074d5f9464d423b33995f1/users/e9c0f9f48e3c49cb9aaa2e87e058cd7e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.242965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcda1f-6b9f-4672-aeb7-3682922d10e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e549f2f0c0074d5f9464d423b33995f1, user_id=e9c0f9f48e3c49cb9aaa2e87e058cd7e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.247973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcda1f-6b9f-4672-aeb7-3682922d10e1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.266587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f53de5d3fb4b6db4a8d6037dadd242, user_id=73e4a12724f24821b9b5f9215d145e25, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.268921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.273435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 791/1574] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:12 2021] PUT /identity/v3/projects/e549f2f0c0074d5f9464d423b33995f1/users/e9c0f9f48e3c49cb9aaa2e87e058cd7e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:12.284623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce154dc-1a67-4b09-8894-340fb3c3d761 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.284992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce154dc-1a67-4b09-8894-340fb3c3d761 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.285312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce154dc-1a67-4b09-8894-340fb3c3d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.301391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 784/1575] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:12 2021] PUT /identity/v3/projects/f3f53de5d3fb4b6db4a8d6037dadd242/users/73e4a12724f24821b9b5f9215d145e25/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:12.302456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:12.341993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-2ce154dc-1a67-4b09-8894-340fb3c3d761 None None] MFA Rules not processed for user `e9c0f9f48e3c49cb9aaa2e87e058cd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:12.345640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2ce154dc-1a67-4b09-8894-340fb3c3d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:12.422828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44893a24-a50c-44c3-81b4-52f5c70cbd8d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:12.431295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.432139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.432488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.432909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.433783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.435817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.449965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 785/1576] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:12 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:12.454292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:12.467379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb57f0-50f6-41e6-98e0-0fd59df8ef9e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:12.482615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b124c-1106-47cb-b743-07304b4c889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.483894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b124c-1106-47cb-b743-07304b4c889a admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.484571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b124c-1106-47cb-b743-07304b4c889a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.484900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b124c-1106-47cb-b743-07304b4c889a admin admin] PATH_INFO: `/v3/projects/f3f53de5d3fb4b6db4a8d6037dadd242/users/73e4a12724f24821b9b5f9215d145e25/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.488502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b124c-1106-47cb-b743-07304b4c889a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f53de5d3fb4b6db4a8d6037dadd242, user_id=73e4a12724f24821b9b5f9215d145e25, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.492805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b124c-1106-47cb-b743-07304b4c889a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.517718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 786/1577] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:12 2021] PUT /identity/v3/projects/f3f53de5d3fb4b6db4a8d6037dadd242/users/73e4a12724f24821b9b5f9215d145e25/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:12.519984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adddb-7444-4975-b81c-095e1a1992c9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.520346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adddb-7444-4975-b81c-095e1a1992c9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.520779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adddb-7444-4975-b81c-095e1a1992c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.545193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 792/1578] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:12 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:12.559005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-292adddb-7444-4975-b81c-095e1a1992c9 None None] MFA Rules not processed for user `73e4a12724f24821b9b5f9215d145e25`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:12.561256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-292adddb-7444-4975-b81c-095e1a1992c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:12.634148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce154dc-1a67-4b09-8894-340fb3c3d761 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:12.652509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 787/1579] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:12 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:12.653995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adddb-7444-4975-b81c-095e1a1992c9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:12.761924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce154dc-1a67-4b09-8894-340fb3c3d761 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:12.806040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adddb-7444-4975-b81c-095e1a1992c9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:12.812623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.813789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.813987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.814388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] PATH_INFO: `/v3/users/f2916b1a2b9f47b1bc82e21cfe352ccc` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.816468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2916b1a2b9f47b1bc82e21cfe352ccc)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:12.819746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:12.893350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:12.894755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:12.895292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:12.895860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:12.953168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2916b1a2b9f47b1bc82e21cfe352ccc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:12.970640 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2916b1a2b9f47b1bc82e21cfe352ccc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:12.973427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2916b1a2b9f47b1bc82e21cfe352ccc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:13.005010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2916b1a2b9f47b1bc82e21cfe352ccc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:13.006277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2f32df50-2f45-4aa4-983e-a9ee5dae4dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2916b1a2b9f47b1bc82e21cfe352ccc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:13.033587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 788/1580] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:12 2021] DELETE /identity/v3/users/f2916b1a2b9f47b1bc82e21cfe352ccc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:13.040446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.041334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.041589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.059554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:13.076555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:13.077798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:13.079475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:13.111598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 793/1581] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:12 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:13.255133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 789/1582] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:13.279127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:13.287010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:13.288876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:13.366435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654bb4-3e35-46ef-9ab0-6d85bcdbfdb7 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:13.376672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8d743-561b-46db-83da-162ba478656d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:13.377344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d743-561b-46db-83da-162ba478656d service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.377622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d743-561b-46db-83da-162ba478656d service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.377892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8d743-561b-46db-83da-162ba478656d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.380148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ffc8d743-561b-46db-83da-162ba478656d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:13.429559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a4053-8655-47b7-bae3-b19f68222b24 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:13.459639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8d743-561b-46db-83da-162ba478656d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:13.461389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8d743-561b-46db-83da-162ba478656d service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:13.472267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 790/1583] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:13 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:13.473849 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7627b-a1b4-4a7b-8299-4dd777a00790 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.474353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7627b-a1b4-4a7b-8299-4dd777a00790 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.474720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7627b-a1b4-4a7b-8299-4dd777a00790 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.477537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 791/1584] 10.222.0.58 () {54 vars in 961 bytes} [Fri Aug 27 03:29:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:13.483674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ae1a4-9fe6-4fd8-9986-607adbae4045 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.484395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ae1a4-9fe6-4fd8-9986-607adbae4045 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.484887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ae1a4-9fe6-4fd8-9986-607adbae4045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.498768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419a7cc-e459-4fa1-94f2-7c5f9af76ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:13.499475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419a7cc-e459-4fa1-94f2-7c5f9af76ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.499763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419a7cc-e459-4fa1-94f2-7c5f9af76ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.500039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419a7cc-e459-4fa1-94f2-7c5f9af76ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.511164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419a7cc-e459-4fa1-94f2-7c5f9af76ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:13.512887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419a7cc-e459-4fa1-94f2-7c5f9af76ae7 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:13.516094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ba8ae1a4-9fe6-4fd8-9986-607adbae4045 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:13.519932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ba8ae1a4-9fe6-4fd8-9986-607adbae4045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:13.524918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 794/1585] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:13.613608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 792/1586] 10.222.0.58 () {58 vars in 1059 bytes} [Fri Aug 27 03:29:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:13.620340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e848b0-5f5b-4452-a57c-bf0394ff1c2b None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.621148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e848b0-5f5b-4452-a57c-bf0394ff1c2b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.621849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e848b0-5f5b-4452-a57c-bf0394ff1c2b None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.625020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 795/1587] 10.222.0.58 () {54 vars in 912 bytes} [Fri Aug 27 03:29:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 03:29:13.643486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a3b96-7bb1-4585-89a0-92fb2108ec58 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.645106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a3b96-7bb1-4585-89a0-92fb2108ec58 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.646120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a3b96-7bb1-4585-89a0-92fb2108ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.695806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2d1a3b96-7bb1-4585-89a0-92fb2108ec58 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:13.699477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2d1a3b96-7bb1-4585-89a0-92fb2108ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:13.725513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 793/1588] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:29:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:13.752420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e848b0-5f5b-4452-a57c-bf0394ff1c2b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:13.755065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-28e848b0-5f5b-4452-a57c-bf0394ff1c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:13.780995 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e848b0-5f5b-4452-a57c-bf0394ff1c2b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:13.792160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d04987-d945-4008-bd3b-a86b6e5d9d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:13.794426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04987-d945-4008-bd3b-a86b6e5d9d36 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:13.794882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04987-d945-4008-bd3b-a86b6e5d9d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:13.796307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04987-d945-4008-bd3b-a86b6e5d9d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:13.825194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04987-d945-4008-bd3b-a86b6e5d9d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:13.828984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04987-d945-4008-bd3b-a86b6e5d9d36 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:13.855785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 796/1589] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:14.831626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff667-3497-4ab7-abad-a17fe4afe3d6 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:14.832511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff667-3497-4ab7-abad-a17fe4afe3d6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:14.833024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff667-3497-4ab7-abad-a17fe4afe3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:14.905811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-9f1ff667-3497-4ab7-abad-a17fe4afe3d6 None None] MFA Rules not processed for user `b514a1dc3cc642f2b83ba52eb39b4420`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:14.907883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9f1ff667-3497-4ab7-abad-a17fe4afe3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:15.068886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 794/1590] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:14 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:15.078430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:15.079012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:15.079012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:15.130580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] MFA Rules not processed for user `b514a1dc3cc642f2b83ba52eb39b4420`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:15.132173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:15.158889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 797/1591] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:15 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:15.173601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ff667-3497-4ab7-abad-a17fe4afe3d6 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:15.211104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ff667-3497-4ab7-abad-a17fe4afe3d6 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:15.222496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:15.223211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:15.223769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:15.223896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:15.249420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:15.251296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:15.277798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 795/1592] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:15 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:15.385696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:15.387491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:15.455185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b90dfd-f3d1-4295-8b80-486b36e8020c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:15.481131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:15.487257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:15.487695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:15.488255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] PATH_INFO: `/v3/projects/4ad9a3dc64ba489d9e9f1393ebab84ca` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:15.501750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad9a3dc64ba489d9e9f1393ebab84ca)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:15.506809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:15.705367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad9a3dc64ba489d9e9f1393ebab84ca', 'request_id': 'req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:15.722720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad9a3dc64ba489d9e9f1393ebab84ca', 'request_id': 'req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:15.758944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad9a3dc64ba489d9e9f1393ebab84ca', 'request_id': 'req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:15.778922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] The token cache is being invalidate because project 4ad9a3dc64ba489d9e9f1393ebab84ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:15.779217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:15.780890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0e4bc0b2-35e5-408c-8bdf-3b9d8150e466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:15.782963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 798/1593] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:15 2021] DELETE /identity/v3/projects/4ad9a3dc64ba489d9e9f1393ebab84ca => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:15.786841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:15.825346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d2621-5f87-48b1-9799-61429df539fc service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:15.828414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf48c-c055-43b6-9a08-7dc46945925b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:15.828864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf48c-c055-43b6-9a08-7dc46945925b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:15.829143 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdbf48c-c055-43b6-9a08-7dc46945925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:15.888677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-6fdbf48c-c055-43b6-9a08-7dc46945925b None None] MFA Rules not processed for user `b0959c5e5b1c49a9b5395f90360ce934`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:15.891214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6fdbf48c-c055-43b6-9a08-7dc46945925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:15.895461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:15.896538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:15.896942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:15.897307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] PATH_INFO: `/v3/users/73e4a12724f24821b9b5f9215d145e25` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:15.898904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e4a12724f24821b9b5f9215d145e25)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:15.901156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:15.971031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e4a12724f24821b9b5f9215d145e25'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:15.984292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 799/1594] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:15.995271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:15.995774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:15.996455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:16.007732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e4a12724f24821b9b5f9215d145e25'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:16.008652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e4a12724f24821b9b5f9215d145e25'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:16.026012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] MFA Rules not processed for user `b0959c5e5b1c49a9b5395f90360ce934`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:16.027476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:16.036308 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 800/1595] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:16.040247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e4a12724f24821b9b5f9215d145e25'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:16.047393 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-71b91c30-310d-4c9d-a5bd-0f0c4ffbb3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e4a12724f24821b9b5f9215d145e25'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:16.050338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:16.053719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:16.069312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 796/1596] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:15 2021] DELETE /identity/v3/users/73e4a12724f24821b9b5f9215d145e25 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:16.145250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e226d9f-7bec-4e6d-82a4-97cd13bf6350 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:16.220765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2399dc-01f6-4255-8d60-f24a17d6f424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:16.220765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2399dc-01f6-4255-8d60-f24a17d6f424 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:16.221098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2399dc-01f6-4255-8d60-f24a17d6f424 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:16.221273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2399dc-01f6-4255-8d60-f24a17d6f424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:16.223752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7e2399dc-01f6-4255-8d60-f24a17d6f424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:16.294132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2399dc-01f6-4255-8d60-f24a17d6f424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:16.297033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2399dc-01f6-4255-8d60-f24a17d6f424 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:16.323973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 801/1597] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:16 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:16.449601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6cc48-594d-4032-8a92-a22d97e1ae88 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:16.449938 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6cc48-594d-4032-8a92-a22d97e1ae88 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:16.450202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6cc48-594d-4032-8a92-a22d97e1ae88 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:16.452308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 797/1598] 10.222.0.58 () {54 vars in 912 bytes} [Fri Aug 27 03:29:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:16.463372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0d3d-783b-4aea-8522-3bff8c0cc808 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:16.463717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0d3d-783b-4aea-8522-3bff8c0cc808 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:16.464008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0d3d-783b-4aea-8522-3bff8c0cc808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:16.552712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-bb9f0d3d-783b-4aea-8522-3bff8c0cc808 None None] MFA Rules not processed for user `3357ca71ec4443f8a9fba9b7ac4cfdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:16.553956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-bb9f0d3d-783b-4aea-8522-3bff8c0cc808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:16.686054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 802/1599] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:29:16 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:16.718145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6cc48-594d-4032-8a92-a22d97e1ae88 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:16.720510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c3d6cc48-594d-4032-8a92-a22d97e1ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:16.746390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6cc48-594d-4032-8a92-a22d97e1ae88 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:16.754934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d762da2-7ac3-4da8-81ee-fb343aebaf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:16.755996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762da2-7ac3-4da8-81ee-fb343aebaf84 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:16.756198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762da2-7ac3-4da8-81ee-fb343aebaf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:16.756478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d762da2-7ac3-4da8-81ee-fb343aebaf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:16.775187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d762da2-7ac3-4da8-81ee-fb343aebaf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:16.776678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d762da2-7ac3-4da8-81ee-fb343aebaf84 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:16.794642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 798/1600] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:16.907494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e14ea2-8738-46bd-a78c-6c59138faca8 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:16.907872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e14ea2-8738-46bd-a78c-6c59138faca8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:16.908153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e14ea2-8738-46bd-a78c-6c59138faca8 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:16.910140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 803/1601] 10.222.0.58 () {54 vars in 912 bytes} [Fri Aug 27 03:29:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:16.916529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:16.917557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:16.918387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:16.939483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] MFA Rules not processed for user `3357ca71ec4443f8a9fba9b7ac4cfdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:16.941298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:16.959211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 799/1602] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:29:16 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:16.977134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e14ea2-8738-46bd-a78c-6c59138faca8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:16.991428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e14ea2-8738-46bd-a78c-6c59138faca8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:16.997148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d2e91-e176-4051-87f0-d2a9956cb001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:16.998219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2e91-e176-4051-87f0-d2a9956cb001 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:16.998709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2e91-e176-4051-87f0-d2a9956cb001 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:16.999821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d2e91-e176-4051-87f0-d2a9956cb001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:17.011781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d2e91-e176-4051-87f0-d2a9956cb001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:17.015972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d2e91-e176-4051-87f0-d2a9956cb001 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:17.036129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 804/1603] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:17.140077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:17.142913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:17.262944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62222e86-d00b-4cad-94d1-f3b7569645f3 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:17.271183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:17.273205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:17.274687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:17.274970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] PATH_INFO: `/v3/projects/f3f53de5d3fb4b6db4a8d6037dadd242` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:17.279181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f53de5d3fb4b6db4a8d6037dadd242)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:17.280342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: WARNING py.warnings [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:17.280342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: warnings.warn(msg) Aug 27 03:29:17.280342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: Aug 27 03:29:17.285326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:17.386496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f53de5d3fb4b6db4a8d6037dadd242', 'request_id': 'req-d1a7be3b-88a2-4437-9935-91b5011ab56c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:17.407760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f53de5d3fb4b6db4a8d6037dadd242', 'request_id': 'req-d1a7be3b-88a2-4437-9935-91b5011ab56c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:17.414476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f53de5d3fb4b6db4a8d6037dadd242', 'request_id': 'req-d1a7be3b-88a2-4437-9935-91b5011ab56c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:17.434110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] The token cache is being invalidate because project f3f53de5d3fb4b6db4a8d6037dadd242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:17.434400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:17.435067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d1a7be3b-88a2-4437-9935-91b5011ab56c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:17.440620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 800/1604] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:17 2021] DELETE /identity/v3/projects/f3f53de5d3fb4b6db4a8d6037dadd242 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:17.450902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f305-c9d3-439e-9fe6-7d246643212b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:17.451627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f305-c9d3-439e-9fe6-7d246643212b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:17.451627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f305-c9d3-439e-9fe6-7d246643212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:17.492658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ee80f305-c9d3-439e-9fe6-7d246643212b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:17.498750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ee80f305-c9d3-439e-9fe6-7d246643212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:17.656100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 805/1605] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:17.664344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6e3a-8696-4100-9f62-6f792a72dda6 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:17.664995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6e3a-8696-4100-9f62-6f792a72dda6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:17.665542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef6e3a-8696-4100-9f62-6f792a72dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:17.700742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-55ef6e3a-8696-4100-9f62-6f792a72dda6 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:17.702482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-55ef6e3a-8696-4100-9f62-6f792a72dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:17.723929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 801/1606] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:17.728672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f305-c9d3-439e-9fe6-7d246643212b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:17.744628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f305-c9d3-439e-9fe6-7d246643212b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:17.768879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:17.775395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:17.777781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:17.778122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:17.783025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:17.784543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:17.790084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:17.845868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef6e3a-8696-4100-9f62-6f792a72dda6 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:17.846058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 806/1607] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:17.862373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef6e3a-8696-4100-9f62-6f792a72dda6 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:17.906326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:17.906992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:17.907382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:17.908155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:17.908998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:17.911948 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:17.984611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:17.985509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 802/1608] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:17 2021] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:17.986425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:17.988198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:18.129552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a08ee-2a22-4920-944d-5bf62edeab80 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:18.143134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:18.145207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.145549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.145850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.148455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:18.154290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:18.235991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 803/1609] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:17 2021] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:18.245994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:18.265685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b35-4c05-4d2e-a96c-2ac89fae1336 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:18.286813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f24bb-42ce-49b7-a648-5b72f008af85 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:18.318675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50751750-f688-4508-9144-cea386ada84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:18.318675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50751750-f688-4508-9144-cea386ada84d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.319927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50751750-f688-4508-9144-cea386ada84d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.325120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50751750-f688-4508-9144-cea386ada84d admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.326904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50751750-f688-4508-9144-cea386ada84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:18.332216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50751750-f688-4508-9144-cea386ada84d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:18.356882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 804/1610] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:18.359211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50751750-f688-4508-9144-cea386ada84d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:18.387518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50751750-f688-4508-9144-cea386ada84d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:18.406914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f4e42-ab17-4c2e-87ad-651ae94b1a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:18.407646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4e42-ab17-4c2e-87ad-651ae94b1a90 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.407920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4e42-ab17-4c2e-87ad-651ae94b1a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.408677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4e42-ab17-4c2e-87ad-651ae94b1a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.408964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f4e42-ab17-4c2e-87ad-651ae94b1a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:18.410572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f4e42-ab17-4c2e-87ad-651ae94b1a90 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:18.432762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 805/1611] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:18.440671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b992835-aeef-4452-bdb5-5ace2b598c3d None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.441601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b992835-aeef-4452-bdb5-5ace2b598c3d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.441887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b992835-aeef-4452-bdb5-5ace2b598c3d None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.448145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 806/1612] 10.222.0.58 () {54 vars in 960 bytes} [Fri Aug 27 03:29:18 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:18.452304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b992835-aeef-4452-bdb5-5ace2b598c3d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:18.455684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09957ee1-e7c0-46f0-b0d5-01e2e3213b06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:18.457530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09957ee1-e7c0-46f0-b0d5-01e2e3213b06 service placement] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.457815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09957ee1-e7c0-46f0-b0d5-01e2e3213b06 service placement] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.472155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09957ee1-e7c0-46f0-b0d5-01e2e3213b06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.476617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-09957ee1-e7c0-46f0-b0d5-01e2e3213b06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:18.490950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09957ee1-e7c0-46f0-b0d5-01e2e3213b06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:18.493060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09957ee1-e7c0-46f0-b0d5-01e2e3213b06 service placement] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:18.496219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b992835-aeef-4452-bdb5-5ace2b598c3d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:18.502813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:18.503881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.504156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.504425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] PATH_INFO: `/v3/projects/ea8cbbec7fac4e74a3eb75839aaf51a9/users/ef4487d363c54672918c197b6c8550ce/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.533956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 807/1613] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:17 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:18.537423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8cbbec7fac4e74a3eb75839aaf51a9, user_id=ef4487d363c54672918c197b6c8550ce, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:18.537623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab078430-8c06-4e62-a88e-49fbeb2cb063 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.539436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab078430-8c06-4e62-a88e-49fbeb2cb063 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.540032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab078430-8c06-4e62-a88e-49fbeb2cb063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.540297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:18.568005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ab078430-8c06-4e62-a88e-49fbeb2cb063 None None] MFA Rules not processed for user `58838486fa5f49c4bca67ad01713fefd`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:18.570437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ab078430-8c06-4e62-a88e-49fbeb2cb063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:18.595439 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 807/1615] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:18 2021] PUT /identity/v3/projects/ea8cbbec7fac4e74a3eb75839aaf51a9/users/ef4487d363c54672918c197b6c8550ce/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:18.595693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 808/1615] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Aug 27 03:29:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:18.596361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:18.658882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c66e0c-8db0-4c5b-8574-5be9b92c164a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.659624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c66e0c-8db0-4c5b-8574-5be9b92c164a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.660420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c66e0c-8db0-4c5b-8574-5be9b92c164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.704483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-71c66e0c-8db0-4c5b-8574-5be9b92c164a None None] MFA Rules not processed for user `ef4487d363c54672918c197b6c8550ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:18.706696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-71c66e0c-8db0-4c5b-8574-5be9b92c164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:18.758103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139185-d7b8-4fdf-b0bb-5359fbeda59b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:18.773981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:18.774845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:18.775127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:18.775996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:18.809960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:18.814518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:18.841092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 809/1616] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:18.845309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c66e0c-8db0-4c5b-8574-5be9b92c164a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:18.848782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 808/1617] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:19.018686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c66e0c-8db0-4c5b-8574-5be9b92c164a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:19.030930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:19.031681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:19.031966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:19.032233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:19.032940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:19.034871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:19.100961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 810/1618] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:18 2021] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:19.104649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:19.118954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f71a6-d150-497c-808b-f51b9ebb4d1c service placement] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:19.240148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:19.243389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:19.243575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:19.247861 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:19.250486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:19.258383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:19.304839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 809/1619] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:19 2021] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:19.308321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:19.321398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6abb-c013-49dc-9210-c377f1f2788e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:19.335427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:19.336840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:19.337181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:19.337820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:19.339460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:19.343472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:19.381069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 811/1620] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:19 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:19.382482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:19.401285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46306ab-4621-4195-ae6d-958b48f74df7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:19.418065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:19.419273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:19.419806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:19.420365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] PATH_INFO: `/v3/projects/f058f56a6d8349bca32ec7cee13cffd8/users/3f36f17a4e5e48ddab52828fd0e88510/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:19.449868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f058f56a6d8349bca32ec7cee13cffd8, user_id=3f36f17a4e5e48ddab52828fd0e88510, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:19.452980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:19.489199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 810/1621] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:19 2021] PUT /identity/v3/projects/f058f56a6d8349bca32ec7cee13cffd8/users/3f36f17a4e5e48ddab52828fd0e88510/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:19.494166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:19.511342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18958f-cde5-495d-824e-d486daedd213 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:19.743519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda015d4-4bd8-4169-a08b-b8b15c054440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:19.751893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda015d4-4bd8-4169-a08b-b8b15c054440 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:19.753297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda015d4-4bd8-4169-a08b-b8b15c054440 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:19.753671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda015d4-4bd8-4169-a08b-b8b15c054440 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:19.758542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda015d4-4bd8-4169-a08b-b8b15c054440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:19.760340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda015d4-4bd8-4169-a08b-b8b15c054440 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:19.817261 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 812/1622] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:19 2021] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:19.821983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:19.835721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930eff-b298-4cc6-a7d4-77cb586668a2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:19.856920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:19.859670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:19.859956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:19.860238 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] PATH_INFO: `/v3/projects/f058f56a6d8349bca32ec7cee13cffd8/users/3f36f17a4e5e48ddab52828fd0e88510/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:19.872104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f058f56a6d8349bca32ec7cee13cffd8, user_id=3f36f17a4e5e48ddab52828fd0e88510, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:19.885290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:19.928503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 811/1623] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:19 2021] PUT /identity/v3/projects/f058f56a6d8349bca32ec7cee13cffd8/users/3f36f17a4e5e48ddab52828fd0e88510/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:19.940533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0392b-ebf4-46b4-bad4-b97620bd4530 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:19.941124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0392b-ebf4-46b4-bad4-b97620bd4530 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:19.941658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0392b-ebf4-46b4-bad4-b97620bd4530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:20.039448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-21d0392b-ebf4-46b4-bad4-b97620bd4530 None None] MFA Rules not processed for user `3f36f17a4e5e48ddab52828fd0e88510`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:20.044072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-21d0392b-ebf4-46b4-bad4-b97620bd4530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:20.244239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 813/1624] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:19 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:20.249505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:20.251958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:20.467517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72909316-d2a8-42b2-b57b-1d7330523221 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:20.471953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:20.472678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:20.472960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:20.473534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:20.564054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:20.566752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:20.612513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 812/1625] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:20 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:21.637009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91ace6-8eed-4dd0-8abf-2c78bb59b777 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:21.637471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91ace6-8eed-4dd0-8abf-2c78bb59b777 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:21.637570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91ace6-8eed-4dd0-8abf-2c78bb59b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:21.775953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-5a91ace6-8eed-4dd0-8abf-2c78bb59b777 None None] MFA Rules not processed for user `5c8979c080c54e9096de897a22ba40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:21.778421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5a91ace6-8eed-4dd0-8abf-2c78bb59b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:21.955923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 814/1626] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:21 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:21.981611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:21.983930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:22.157760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b3ec-8346-493f-b067-5433635bfcad service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:22.181751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:22.183340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:22.185210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:22.185767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:22.214222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:22.216102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:22.239274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 813/1627] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:21 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:22.585231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:22.585811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:22.586263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:22.648910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] MFA Rules not processed for user `75cb79bac8944976a2689f62b8d014e2`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:22.654656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:22.805864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 815/1628] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:22 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:22.866569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:22.868469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:22.892869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615fb34-c52f-4e6d-9c56-445f7f382bff service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:22.908369 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298252cd-1fb1-4f6b-bc78-da51d2746424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:22.909101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298252cd-1fb1-4f6b-bc78-da51d2746424 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:22.909419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298252cd-1fb1-4f6b-bc78-da51d2746424 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:22.909878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298252cd-1fb1-4f6b-bc78-da51d2746424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:22.920131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298252cd-1fb1-4f6b-bc78-da51d2746424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:22.933246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298252cd-1fb1-4f6b-bc78-da51d2746424 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:22.968890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 814/1629] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:22 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:23.013764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:23.013764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:23.158160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6870ff-d63f-4036-8bd6-7500c3fe3497 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:23.175157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:23.179661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:23.179661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:23.182179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] PATH_INFO: `/v3/users/38b4144ff3f14c24be2c22a657b470ac` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:23.185525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b4144ff3f14c24be2c22a657b470ac)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:23.192723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: WARNING py.warnings [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:29:23.192723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: warnings.warn(msg) Aug 27 03:29:23.192723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: Aug 27 03:29:23.195969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:23.339341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b4144ff3f14c24be2c22a657b470ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:23.376388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b4144ff3f14c24be2c22a657b470ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:23.412385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b4144ff3f14c24be2c22a657b470ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:23.413212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b4144ff3f14c24be2c22a657b470ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:23.427395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b4144ff3f14c24be2c22a657b470ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:23.439357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 816/1630] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:23 2021] DELETE /identity/v3/users/38b4144ff3f14c24be2c22a657b470ac => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:23.444234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:23.444822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:23.445453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:23.491019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:23.496668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:23.600855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 815/1631] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:23.625229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:23.626951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:23.793459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c637d6-1dcf-431d-b5f5-654806ec22c2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:23.805465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0b11a-57cf-4a56-a563-8300e99af85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:23.806151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b11a-57cf-4a56-a563-8300e99af85b service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:23.806431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b11a-57cf-4a56-a563-8300e99af85b service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:23.812846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0b11a-57cf-4a56-a563-8300e99af85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:23.838332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b11a-57cf-4a56-a563-8300e99af85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:23.840211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0b11a-57cf-4a56-a563-8300e99af85b service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:23.878813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 817/1632] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:24.598988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:24.600841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:24.632102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2332b-cf2c-49e0-a35f-babc7ad82501 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:24.640289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:24.641053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:24.641434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:24.641596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] PATH_INFO: `/v3/projects/e9d6a5b656034075ab6587199d369ecb` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:24.643606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d6a5b656034075ab6587199d369ecb)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:24.647937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:24.715206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d6a5b656034075ab6587199d369ecb', 'request_id': 'req-7c4bd230-5832-44bb-a021-19ed2903bb79'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:24.722783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d6a5b656034075ab6587199d369ecb', 'request_id': 'req-7c4bd230-5832-44bb-a021-19ed2903bb79'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:24.733555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d6a5b656034075ab6587199d369ecb', 'request_id': 'req-7c4bd230-5832-44bb-a021-19ed2903bb79'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:24.772962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] The token cache is being invalidate because project e9d6a5b656034075ab6587199d369ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:24.773959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:24.777399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7c4bd230-5832-44bb-a021-19ed2903bb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:24.782694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 816/1633] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:24 2021] DELETE /identity/v3/projects/e9d6a5b656034075ab6587199d369ecb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:24.788342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a5bf-6c7f-491c-9af2-89f5299537de None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:24.789287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a5bf-6c7f-491c-9af2-89f5299537de None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:24.789859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a5bf-6c7f-491c-9af2-89f5299537de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:24.814768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7225a5bf-6c7f-491c-9af2-89f5299537de None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:24.817276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7225a5bf-6c7f-491c-9af2-89f5299537de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:24.921997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 818/1634] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:24.929494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1edc29-e316-49dd-9a37-8983a705221a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:24.930593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1edc29-e316-49dd-9a37-8983a705221a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:24.930944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1edc29-e316-49dd-9a37-8983a705221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:24.974468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ed1edc29-e316-49dd-9a37-8983a705221a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:24.975884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ed1edc29-e316-49dd-9a37-8983a705221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:25.023958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 817/1635] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:25.024875 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a5bf-6c7f-491c-9af2-89f5299537de None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:25.041217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a5bf-6c7f-491c-9af2-89f5299537de None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:25.067652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:25.068154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:25.068746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:25.068746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:25.082249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:25.083222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:25.085051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:25.100569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 819/1636] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:25.105190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1edc29-e316-49dd-9a37-8983a705221a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:25.119175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1edc29-e316-49dd-9a37-8983a705221a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:25.131967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:25.132730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:25.133011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:25.133281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:25.133989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:25.137822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:25.204063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 818/1637] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:25 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:25.208611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:25.224796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6044-f3de-4892-a630-61cf61a29914 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:25.380671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:25.381375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:25.381659 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:25.381936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:25.382712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:25.385574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:25.463725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 820/1638] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:25 2021] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:25.467496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:25.480430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa20347-84b3-4494-8b90-c275bcaaadde admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:25.490153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:25.491609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:25.492121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:25.492757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:25.493691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:25.495505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:25.517174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 819/1639] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:25 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:25.517468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:25.528969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078e3eb-8dd5-40ad-bf1c-00e6fc06ecc5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:25.535204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a31863-c41f-4549-b076-4814abccc3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:25.536049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a31863-c41f-4549-b076-4814abccc3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:25.536403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a31863-c41f-4549-b076-4814abccc3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:25.536797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a31863-c41f-4549-b076-4814abccc3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:25.537541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a31863-c41f-4549-b076-4814abccc3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:25.539951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a31863-c41f-4549-b076-4814abccc3f8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:25.583110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:25.593493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 821/1640] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:25 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:25.600680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f8d6-84ab-42d5-b29e-2cab37bf1abc admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:25.607927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:25.609163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:25.609661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:25.610304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] PATH_INFO: `/v3/projects/19a09214617f453aa055edf782002995/users/672c99cc1fc14a21b317641eb6b7b7b2/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:25.631241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a09214617f453aa055edf782002995, user_id=672c99cc1fc14a21b317641eb6b7b7b2, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:25.634758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:25.666604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 820/1641] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:25 2021] PUT /identity/v3/projects/19a09214617f453aa055edf782002995/users/672c99cc1fc14a21b317641eb6b7b7b2/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:25.677095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecde14f-343c-4768-9229-79e3f11ba80f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:25.677473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecde14f-343c-4768-9229-79e3f11ba80f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:25.677744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecde14f-343c-4768-9229-79e3f11ba80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:25.759307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-fecde14f-343c-4768-9229-79e3f11ba80f None None] MFA Rules not processed for user `672c99cc1fc14a21b317641eb6b7b7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:25.760583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fecde14f-343c-4768-9229-79e3f11ba80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:25.987013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 822/1642] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:25 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:25.991703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:26.110902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931c24-5814-4fb5-b5cc-23876876145d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:26.111777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931c24-5814-4fb5-b5cc-23876876145d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:26.112144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931c24-5814-4fb5-b5cc-23876876145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:26.185530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-37931c24-5814-4fb5-b5cc-23876876145d None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:26.190610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-37931c24-5814-4fb5-b5cc-23876876145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:26.201500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e870-847e-4258-a969-d2e6530bbd96 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:26.220794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:26.222836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:26.223361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:26.223852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:26.224772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:26.232187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:26.327991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 821/1643] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:25 2021] POST /identity/v3/projects => generated 381 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:26.329523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:26.404924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 823/1644] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:29:26 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:26.464081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16879d-a19a-4c0b-a2a5-83deb7e7f974 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:26.470389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:26.472137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:26.472625 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:26.473126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:26.474161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:26.476829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:26.512720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 822/1645] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:26 2021] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:26.513960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37931c24-5814-4fb5-b5cc-23876876145d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:26.536548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37931c24-5814-4fb5-b5cc-23876876145d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:26.548456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:26.558191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:26.558484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:26.558767 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:26.559573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:26.562549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:26.610297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 824/1646] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:26 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:26.612175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:26.631960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:26.633498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d8ff-7df9-4baa-9d9e-5cb2800bd6fc admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:26.640297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:26.650956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:26.652003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:26.653031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:26.653537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] PATH_INFO: `/v3/projects/9f07147f7c4349a18e350cc820990e04/users/21b6f8a8e1df444cb3983a9ce004d8d5/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:26.707190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f07147f7c4349a18e350cc820990e04, user_id=21b6f8a8e1df444cb3983a9ce004d8d5, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:26.719665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:26.764026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 823/1647] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:26 2021] PUT /identity/v3/projects/9f07147f7c4349a18e350cc820990e04/users/21b6f8a8e1df444cb3983a9ce004d8d5/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:26.765097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:26.816647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d678a-97fa-4bb1-b128-a344003b18cd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:26.936068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10548e-5048-4d14-9030-822895b436b7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:26.955321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:26.956425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:26.957618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:26.958081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:26.959136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:26.961807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:26.972902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:26.974186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:26.974186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:26.974186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:26.985514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 824/1648] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:26 2021] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:26.986717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:26.989054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:27.125952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3614-9da8-4e9f-810d-04fcd3d475ae admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:27.135950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f00fb-c7c3-4204-a179-e13551250da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:27.137018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f00fb-c7c3-4204-a179-e13551250da6 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:27.137475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f00fb-c7c3-4204-a179-e13551250da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:27.138438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f00fb-c7c3-4204-a179-e13551250da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:27.142422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9e0f00fb-c7c3-4204-a179-e13551250da6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:27.193672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:27.202393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:27.242781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 825/1649] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:29:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:29:27.243873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:27.290565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde7a59-40e4-4b70-8e96-19211aea0d7d service swift] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:27.305990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7daae24-15dc-468f-b21b-921c66d9161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:27.306826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daae24-15dc-468f-b21b-921c66d9161e admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:27.312754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daae24-15dc-468f-b21b-921c66d9161e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:27.312936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7daae24-15dc-468f-b21b-921c66d9161e admin admin] PATH_INFO: `/v3/projects/9f07147f7c4349a18e350cc820990e04/users/21b6f8a8e1df444cb3983a9ce004d8d5/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:27.318121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f00fb-c7c3-4204-a179-e13551250da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:27.319186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daae24-15dc-468f-b21b-921c66d9161e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f07147f7c4349a18e350cc820990e04, user_id=21b6f8a8e1df444cb3983a9ce004d8d5, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:27.322361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7daae24-15dc-468f-b21b-921c66d9161e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:27.324375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f00fb-c7c3-4204-a179-e13551250da6 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:27.375104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 825/1650] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:26 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:27.380951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:27.382657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:27.384915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 826/1651] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:27 2021] PUT /identity/v3/projects/9f07147f7c4349a18e350cc820990e04/users/21b6f8a8e1df444cb3983a9ce004d8d5/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:27.386124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:27.458656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041d67-844a-4fd2-8fab-4080a8eebbeb None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:27.459579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041d67-844a-4fd2-8fab-4080a8eebbeb None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:27.460047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04041d67-844a-4fd2-8fab-4080a8eebbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:27.486594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] MFA Rules not processed for user `5c8979c080c54e9096de897a22ba40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:27.489850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:27.601990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-04041d67-844a-4fd2-8fab-4080a8eebbeb None None] MFA Rules not processed for user `21b6f8a8e1df444cb3983a9ce004d8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:27.608394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-04041d67-844a-4fd2-8fab-4080a8eebbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:27.788012 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 826/1652] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:27 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:27.891644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 827/1653] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:27 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:27.902449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:27.904215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:28.035835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898ca65-c3b7-4ec2-8e2a-3051bb18b9bf None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:28.047116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:28.049557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:28.050759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:28.052216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:28.089333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:28.091814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:28.147222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 827/1654] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:27 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:28.352081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:28.352604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:28.352703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:28.456846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:28.457467 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] MFA Rules not processed for user `75cb79bac8944976a2689f62b8d014e2`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:28.462080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:28.483598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e103f44-a3b0-4437-b02c-9e8f6ddcedd0 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:28.493662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bad8e-5cb1-4eba-8fba-479643f12047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:28.494336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bad8e-5cb1-4eba-8fba-479643f12047 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:28.494813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bad8e-5cb1-4eba-8fba-479643f12047 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:28.495093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bad8e-5cb1-4eba-8fba-479643f12047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:28.635686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 828/1655] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:28 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:28.679621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bad8e-5cb1-4eba-8fba-479643f12047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:28.690005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bad8e-5cb1-4eba-8fba-479643f12047 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:28.716727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 828/1656] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:28 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:32.801951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:32.803430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:32.917842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8dbdd-9038-49a9-8218-5fdf1e405a14 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:32.922696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:32.924845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:32.924845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:32.925184 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] PATH_INFO: `/v3/users/4f728e6c51da49f2a55d54ea67f265d0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:32.926426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f728e6c51da49f2a55d54ea67f265d0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:32.928442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:32.987669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f728e6c51da49f2a55d54ea67f265d0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.008662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f728e6c51da49f2a55d54ea67f265d0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.018696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f728e6c51da49f2a55d54ea67f265d0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.019670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f728e6c51da49f2a55d54ea67f265d0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.040511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f728e6c51da49f2a55d54ea67f265d0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.049136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 829/1657] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:32 2021] DELETE /identity/v3/users/4f728e6c51da49f2a55d54ea67f265d0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:33.054535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:33.055801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:33.056080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:33.077145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:33.078894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:33.158821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 829/1658] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:33.170055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:33.172330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:33.244214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ca7e2-dae0-4b2c-a832-a56ceba4d553 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:33.248166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d285-110d-4b5d-83fa-5682a2a9028b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:33.248826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d285-110d-4b5d-83fa-5682a2a9028b service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:33.249113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d285-110d-4b5d-83fa-5682a2a9028b service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:33.249478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d285-110d-4b5d-83fa-5682a2a9028b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:33.261676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d285-110d-4b5d-83fa-5682a2a9028b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:33.263951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d285-110d-4b5d-83fa-5682a2a9028b service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:33.279274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 830/1659] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:33.667839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:33.669231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:33.689074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138ba5a-d39a-446b-b0fc-6351c2e03fb0 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:33.694759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:33.695925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:33.696360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:33.696819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] PATH_INFO: `/v3/projects/fc0a4b80aa5f45e0969ed7ba3c559e31` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:33.698131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0a4b80aa5f45e0969ed7ba3c559e31)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:33.708968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:33.759502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0a4b80aa5f45e0969ed7ba3c559e31', 'request_id': 'req-44f50a4b-ee70-48df-a865-d56fc2e016a8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.766229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0a4b80aa5f45e0969ed7ba3c559e31', 'request_id': 'req-44f50a4b-ee70-48df-a865-d56fc2e016a8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.772366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0a4b80aa5f45e0969ed7ba3c559e31', 'request_id': 'req-44f50a4b-ee70-48df-a865-d56fc2e016a8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.788363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] The token cache is being invalidate because project fc0a4b80aa5f45e0969ed7ba3c559e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:33.788840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.789588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:33.795206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 830/1660] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:33 2021] DELETE /identity/v3/projects/fc0a4b80aa5f45e0969ed7ba3c559e31 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:33.796968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1ba82-3f54-46a1-9144-80ea86a74536 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:33.797265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1ba82-3f54-46a1-9144-80ea86a74536 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:33.797549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1ba82-3f54-46a1-9144-80ea86a74536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:33.824182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-34c1ba82-3f54-46a1-9144-80ea86a74536 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:33.826145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-34c1ba82-3f54-46a1-9144-80ea86a74536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:33.895625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 831/1661] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:33.896433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:33.897951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:33.903585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3c9b-cec4-4b52-bd44-4345a1f77498 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:33.903870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3c9b-cec4-4b52-bd44-4345a1f77498 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:33.904141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3c9b-cec4-4b52-bd44-4345a1f77498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:33.912109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f50a4b-ee70-48df-a865-d56fc2e016a8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:33.918329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:33.919626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:33.920331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:33.920850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] PATH_INFO: `/v3/users/672c99cc1fc14a21b317641eb6b7b7b2` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:33.922402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672c99cc1fc14a21b317641eb6b7b7b2)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:33.924637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:33.930620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-402f3c9b-cec4-4b52-bd44-4345a1f77498 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:33.931903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-402f3c9b-cec4-4b52-bd44-4345a1f77498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:33.963253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 832/1662] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:33.965289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3c9b-cec4-4b52-bd44-4345a1f77498 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:33.989552 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3c9b-cec4-4b52-bd44-4345a1f77498 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.000137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.001837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.002167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.002720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672c99cc1fc14a21b317641eb6b7b7b2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:34.003703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.004773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:34.005273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.007772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.012239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672c99cc1fc14a21b317641eb6b7b7b2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:34.013242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672c99cc1fc14a21b317641eb6b7b7b2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:34.027385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672c99cc1fc14a21b317641eb6b7b7b2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:34.028529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2738de18-4052-4063-9e6f-9b5a00713ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672c99cc1fc14a21b317641eb6b7b7b2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:34.038137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 833/1663] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:34.039160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.041411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:34.055376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a365cb-f305-4c57-af28-28c399d65a50 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.060662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.061423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.061785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.062119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.062876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.064878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.068347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 831/1664] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:33 2021] DELETE /identity/v3/users/672c99cc1fc14a21b317641eb6b7b7b2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:34.074310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.074765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.075141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.097935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:34.099774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:34.138556 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 834/1665] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:34 2021] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:34.145302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.227178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 832/1666] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:34.241083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.242935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:34.287386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a440d-9a5f-4ba0-8578-3d8b1bc7f37c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.293029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.293717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.294001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.294279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.294977 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.296953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.327675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 835/1667] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:34 2021] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:34.329065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ee9d-3ef3-4a66-8c0f-f86ef38ba4aa None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.332120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.345180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cbd0a-8c19-4bc0-b38f-b3718b3885b0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.350960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.351839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.352189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.352525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.353763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.355721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.383454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 836/1668] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:34 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:29:34.385453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.404615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccf181-39d1-4ce0-86ad-13db2d833b1a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.409549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.411341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.412043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.412748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.413973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.416557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.429247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 837/1669] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:34 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:34.430921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979feb8a-08a6-406c-a4d2-22b676be9327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.431623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979feb8a-08a6-406c-a4d2-22b676be9327 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.431911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979feb8a-08a6-406c-a4d2-22b676be9327 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.432189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979feb8a-08a6-406c-a4d2-22b676be9327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.434013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.441845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979feb8a-08a6-406c-a4d2-22b676be9327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.443296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979feb8a-08a6-406c-a4d2-22b676be9327 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.443482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ab53-2025-4276-bede-57f5d99596a4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.453644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 833/1670] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:34.462777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.469238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.469695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.469901 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] PATH_INFO: `/v3/projects/c01469046c094df1b670f022cf0ffa82/users/e0b9315fc9b54474ac39d539d5be91df/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.511018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01469046c094df1b670f022cf0ffa82, user_id=e0b9315fc9b54474ac39d539d5be91df, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.514541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.566810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 838/1671] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:34 2021] PUT /identity/v3/projects/c01469046c094df1b670f022cf0ffa82/users/e0b9315fc9b54474ac39d539d5be91df/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:34.578090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39487f-9cb9-4885-bc6b-0c298db4fd8d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.578490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39487f-9cb9-4885-bc6b-0c298db4fd8d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.578856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39487f-9cb9-4885-bc6b-0c298db4fd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.621485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-4b39487f-9cb9-4885-bc6b-0c298db4fd8d None None] MFA Rules not processed for user `e0b9315fc9b54474ac39d539d5be91df`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:34.623070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4b39487f-9cb9-4885-bc6b-0c298db4fd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:34.727711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 834/1672] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:34 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:34.731951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.830857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06eaa7-c2d7-406b-9c0a-18f87c97b678 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:34.839132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:34.840017 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:34.840454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:34.840884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:34.842000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:34.846294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:34.895524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 839/1673] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:34 2021] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:34.899090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39487f-9cb9-4885-bc6b-0c298db4fd8d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.914992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:34.917549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:34.919242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39487f-9cb9-4885-bc6b-0c298db4fd8d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.046443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.047299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.047765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.048053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.048769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.050761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.054604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5031e4-93e4-43bb-a2d6-fd186a46b193 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.059890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.060896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.061242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.061581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] PATH_INFO: `/v3/projects/19a09214617f453aa055edf782002995` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.062850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a09214617f453aa055edf782002995)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.065218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.074425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 835/1674] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:34 2021] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:35.075740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:35.086342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff1f5c-7a40-4b4f-852e-63bade58f453 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.090911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.091640 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.091890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.092208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.093408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.094525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.113848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 836/1675] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:35 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:29:35.119335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:35.123733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a09214617f453aa055edf782002995', 'request_id': 'req-669ddb47-8ec2-4c20-8e50-95a08a669fc4'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.133097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a09214617f453aa055edf782002995', 'request_id': 'req-669ddb47-8ec2-4c20-8e50-95a08a669fc4'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.133484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499b4c3-e56b-4bc1-81ff-fde4d3a6d670 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.143817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a09214617f453aa055edf782002995', 'request_id': 'req-669ddb47-8ec2-4c20-8e50-95a08a669fc4'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.157551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] The token cache is being invalidate because project 19a09214617f453aa055edf782002995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:35.157785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.158419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.160605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 840/1676] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:34 2021] DELETE /identity/v3/projects/19a09214617f453aa055edf782002995 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:35.164409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:35.165981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:35.204120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.205024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.205303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.205574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] PATH_INFO: `/v3/projects/5fa735c7282a4578a166fd4b98d2e3a3/users/d5735049b4ad4fecab362657746db6a0/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.220716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa735c7282a4578a166fd4b98d2e3a3, user_id=d5735049b4ad4fecab362657746db6a0, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.223719 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.237127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ddb47-8ec2-4c20-8e50-95a08a669fc4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.246481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 837/1677] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:35 2021] PUT /identity/v3/projects/5fa735c7282a4578a166fd4b98d2e3a3/users/d5735049b4ad4fecab362657746db6a0/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:35.247877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:35.261517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:35.321495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.322392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.322670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.322946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] PATH_INFO: `/v3/users/21b6f8a8e1df444cb3983a9ce004d8d5` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.324192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b6f8a8e1df444cb3983a9ce004d8d5)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.326230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.381193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4cbc-84d9-4e91-a867-a3c7fb0ee261 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.387318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.388172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.388571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.388915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.394642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.394642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.407630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 838/1678] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:35 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:29:35.411879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:35.418205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b6f8a8e1df444cb3983a9ce004d8d5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.424987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbada61-2528-48b3-aa79-d6252d3df25b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.439754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b6f8a8e1df444cb3983a9ce004d8d5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.440129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aac2e7-5aa4-4059-a9d6-78c65d88e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.441377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aac2e7-5aa4-4059-a9d6-78c65d88e0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.441733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aac2e7-5aa4-4059-a9d6-78c65d88e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.442395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aac2e7-5aa4-4059-a9d6-78c65d88e0b3 admin admin] PATH_INFO: `/v3/projects/5fa735c7282a4578a166fd4b98d2e3a3/users/d5735049b4ad4fecab362657746db6a0/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.444563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aac2e7-5aa4-4059-a9d6-78c65d88e0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa735c7282a4578a166fd4b98d2e3a3, user_id=d5735049b4ad4fecab362657746db6a0, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.448074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aac2e7-5aa4-4059-a9d6-78c65d88e0b3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.455283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b6f8a8e1df444cb3983a9ce004d8d5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.456306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b6f8a8e1df444cb3983a9ce004d8d5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.459664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 839/1679] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:35 2021] PUT /identity/v3/projects/5fa735c7282a4578a166fd4b98d2e3a3/users/d5735049b4ad4fecab362657746db6a0/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:35.471848 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b6f8a8e1df444cb3983a9ce004d8d5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:35.480836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 841/1680] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:35 2021] DELETE /identity/v3/users/21b6f8a8e1df444cb3983a9ce004d8d5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:35.509602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.509895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.510221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.551986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] MFA Rules not processed for user `d5735049b4ad4fecab362657746db6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:35.554658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:35.675141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 840/1681] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:35 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:35.692690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:35.694316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:35.807267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a408f9-a029-4668-9602-0221c0f5d7fb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:35.821711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:35.822720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:35.823013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:35.823297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:35.834190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:35.835685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:35.860926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 842/1682] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:35 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:35.920508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:35.922498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.026015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.028519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.049341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45b18a-eecd-4bea-9507-37dbda43cc2a service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.056492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.057636 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.058135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.058422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] PATH_INFO: `/v3/projects/9f07147f7c4349a18e350cc820990e04` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.059932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f07147f7c4349a18e350cc820990e04)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.061918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.065314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47116cc9-6e61-43eb-aea2-ca276b9f696d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.079431 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.087539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.087539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.087539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] PATH_INFO: `/v3/users/e0b9315fc9b54474ac39d539d5be91df` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.089710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b9315fc9b54474ac39d539d5be91df)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.091982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.141104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f07147f7c4349a18e350cc820990e04', 'request_id': 'req-7f576b68-84e9-423f-93ca-7bf950e0ea69'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.153659 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f07147f7c4349a18e350cc820990e04', 'request_id': 'req-7f576b68-84e9-423f-93ca-7bf950e0ea69'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.169167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f07147f7c4349a18e350cc820990e04', 'request_id': 'req-7f576b68-84e9-423f-93ca-7bf950e0ea69'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.174635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b9315fc9b54474ac39d539d5be91df'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.182542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] The token cache is being invalidate because project 9f07147f7c4349a18e350cc820990e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:36.183096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.183807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7f576b68-84e9-423f-93ca-7bf950e0ea69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.184887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b9315fc9b54474ac39d539d5be91df'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.185384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 843/1683] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:36 2021] DELETE /identity/v3/projects/9f07147f7c4349a18e350cc820990e04 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:36.185911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b9315fc9b54474ac39d539d5be91df'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.191044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086869-eb8d-4164-8650-de78386008c9 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.191335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086869-eb8d-4164-8650-de78386008c9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.191641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086869-eb8d-4164-8650-de78386008c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.200204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b9315fc9b54474ac39d539d5be91df'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.200978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-639b49aa-a78f-437c-aa3f-b0d9c482b945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b9315fc9b54474ac39d539d5be91df'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:36.229002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1e086869-eb8d-4164-8650-de78386008c9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:36.231685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1e086869-eb8d-4164-8650-de78386008c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.241225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 841/1684] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:35 2021] DELETE /identity/v3/users/e0b9315fc9b54474ac39d539d5be91df => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:36.245620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.247323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.249041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.279648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:36.281507 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.315874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 844/1685] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:36.324286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c160bf8-5a21-4382-80a7-17d8e5512526 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.324649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c160bf8-5a21-4382-80a7-17d8e5512526 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.324964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c160bf8-5a21-4382-80a7-17d8e5512526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.348693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-4c160bf8-5a21-4382-80a7-17d8e5512526 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:36.349990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4c160bf8-5a21-4382-80a7-17d8e5512526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.381950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 842/1686] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:36.396291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.398039 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.421888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 845/1687] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:36.424565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c160bf8-5a21-4382-80a7-17d8e5512526 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.435801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c160bf8-5a21-4382-80a7-17d8e5512526 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.442022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.442364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.442647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.442969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.443755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:36.444063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.446008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.464057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 846/1688] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:36.464386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c874-c832-4cdf-a033-2737b73d967b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.465031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.468297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.469120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.469411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.469688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.476218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673646d5-88aa-472f-95ab-d43428971b74 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.481460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.481668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.482384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.482671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.482985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.483089 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.483824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.485953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.494401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 843/1689] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:36.513372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 847/1690] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:36 2021] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:36.517658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.527782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a44bc9-e30c-4d6f-8aac-6fe52570179a service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.609371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.610717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.611242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.611780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.613842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.616224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.647009 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 844/1691] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:36 2021] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:36.652075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.662715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28492e-e40f-4cfe-af62-a7877eb42738 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.668449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.669025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.669311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.669596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.670339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.675333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.693147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 848/1692] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:36 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:36.697755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.710937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302219b-238f-4b3b-9601-1a19e6db098c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.718160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5e5dd-6f24-41a0-9d8f-0b2a5610303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.719004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5e5dd-6f24-41a0-9d8f-0b2a5610303d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.719287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5e5dd-6f24-41a0-9d8f-0b2a5610303d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.720209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5e5dd-6f24-41a0-9d8f-0b2a5610303d admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.720959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5e5dd-6f24-41a0-9d8f-0b2a5610303d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.722588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5e5dd-6f24-41a0-9d8f-0b2a5610303d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.743885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 845/1693] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:36 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:36.745283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.756120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ca42-ea47-4e65-804e-5dc46e782ab9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.762246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.763206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.763835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.764479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] PATH_INFO: `/v3/projects/bc6dc913cb414a64a6aef6702da14f52/users/fb7d8ce180a14bb88c348cbc3471e118/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.782516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6dc913cb414a64a6aef6702da14f52, user_id=fb7d8ce180a14bb88c348cbc3471e118, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.784278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.807902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 849/1694] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:36 2021] PUT /identity/v3/projects/bc6dc913cb414a64a6aef6702da14f52/users/fb7d8ce180a14bb88c348cbc3471e118/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:36.813599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3569e5-bddf-4109-8ac4-b2cfa6936dbf None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.817425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3569e5-bddf-4109-8ac4-b2cfa6936dbf None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.817917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3569e5-bddf-4109-8ac4-b2cfa6936dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.845573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:36.847872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.882496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1d3569e5-bddf-4109-8ac4-b2cfa6936dbf None None] MFA Rules not processed for user `fb7d8ce180a14bb88c348cbc3471e118`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:36.883803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1d3569e5-bddf-4109-8ac4-b2cfa6936dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:36.935452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892cb2-6c08-4eb5-8ce4-18546c673e5d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:36.949006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:36.950085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:36.950370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:36.951490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] PATH_INFO: `/v3/projects/c01469046c094df1b670f022cf0ffa82` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:36.953247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01469046c094df1b670f022cf0ffa82)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:36.955165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:36.982757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 846/1695] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:36 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:36.987608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3569e5-bddf-4109-8ac4-b2cfa6936dbf None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.004703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3569e5-bddf-4109-8ac4-b2cfa6936dbf None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.016167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01469046c094df1b670f022cf0ffa82', 'request_id': 'req-4ab235f1-0b44-4d60-9304-e2689d5f0705'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.022574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01469046c094df1b670f022cf0ffa82', 'request_id': 'req-4ab235f1-0b44-4d60-9304-e2689d5f0705'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.031366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01469046c094df1b670f022cf0ffa82', 'request_id': 'req-4ab235f1-0b44-4d60-9304-e2689d5f0705'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.048869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] The token cache is being invalidate because project c01469046c094df1b670f022cf0ffa82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:37.050002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.050715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.052792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 850/1696] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:36 2021] DELETE /identity/v3/projects/c01469046c094df1b670f022cf0ffa82 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:37.057161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.058612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:37.091945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.092779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.093149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.093610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.094368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.096891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.132023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 847/1697] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:36 2021] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:37.136272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.138118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:37.151168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab235f1-0b44-4d60-9304-e2689d5f0705 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.252421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee74ab-b0d3-4c83-9b9c-bf031f55c2aa admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.256911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.258013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.258149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.258296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.258391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.258749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] PATH_INFO: `/v3/users/d5735049b4ad4fecab362657746db6a0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.259589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.259875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.260413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5735049b4ad4fecab362657746db6a0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.260934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.262427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.262931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.306835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 848/1698] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:37 2021] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:37.309065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.330299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c082f-74b0-445b-bb93-4e5fb9b7d376 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.343340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.344053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.344351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.344638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.345488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5735049b4ad4fecab362657746db6a0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.347809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.349516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.371090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 849/1699] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:37 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:37.372405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5735049b4ad4fecab362657746db6a0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.375518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.388871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5735049b4ad4fecab362657746db6a0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.390154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5735049b4ad4fecab362657746db6a0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.392381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0dfc8-12bd-468f-9efb-3e61140bf02c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.398672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.399898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.400106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.400442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] PATH_INFO: `/v3/projects/5b406c3775de4b9386b024becd8db2c0/users/6c5b841bb8d04b06b195b8583ba58a64/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.417443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5735049b4ad4fecab362657746db6a0'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.425321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 851/1700] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:37 2021] DELETE /identity/v3/users/d5735049b4ad4fecab362657746db6a0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:37.431134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b406c3775de4b9386b024becd8db2c0, user_id=6c5b841bb8d04b06b195b8583ba58a64, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.441440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.466278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 850/1701] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:37 2021] PUT /identity/v3/projects/5b406c3775de4b9386b024becd8db2c0/users/6c5b841bb8d04b06b195b8583ba58a64/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:37.470268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.471754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:37.576082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599d9c-fba2-477f-b671-d8f51bd94c6a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.683313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afead9ac-ecc6-44f2-8033-751e2091a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.684104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afead9ac-ecc6-44f2-8033-751e2091a071 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.684395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afead9ac-ecc6-44f2-8033-751e2091a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.684671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afead9ac-ecc6-44f2-8033-751e2091a071 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.685414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afead9ac-ecc6-44f2-8033-751e2091a071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.687030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afead9ac-ecc6-44f2-8033-751e2091a071 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.697719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 852/1702] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:37 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:29:37.701899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.713199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243953-601a-405c-9696-0e77690aa201 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.718368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.719329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.719647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.719921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] PATH_INFO: `/v3/projects/5b406c3775de4b9386b024becd8db2c0/users/6c5b841bb8d04b06b195b8583ba58a64/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.721940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b406c3775de4b9386b024becd8db2c0, user_id=6c5b841bb8d04b06b195b8583ba58a64, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.724632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.735020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 851/1703] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:37 2021] PUT /identity/v3/projects/5b406c3775de4b9386b024becd8db2c0/users/6c5b841bb8d04b06b195b8583ba58a64/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:37.747704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.748069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.748440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.783234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] MFA Rules not processed for user `6c5b841bb8d04b06b195b8583ba58a64`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:37.784776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:37.818929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.822176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:37.871830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 853/1704] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:37 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:37.880849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:37.883094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:37.903889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd971a-034d-4525-862a-98f93d0b74db admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.927435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.928360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.928630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.928952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] PATH_INFO: `/v3/projects/5fa735c7282a4578a166fd4b98d2e3a3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.930985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa735c7282a4578a166fd4b98d2e3a3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.933067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.957097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebf329-7b49-4f1d-afb8-e38c2a0e24b5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:37.962717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75181-db54-4a9f-8365-7fc926b2e8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:37.962975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75181-db54-4a9f-8365-7fc926b2e8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:37.963424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75181-db54-4a9f-8365-7fc926b2e8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:37.963760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75181-db54-4a9f-8365-7fc926b2e8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:37.974831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75181-db54-4a9f-8365-7fc926b2e8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:37.976630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75181-db54-4a9f-8365-7fc926b2e8e8 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:37.991826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa735c7282a4578a166fd4b98d2e3a3', 'request_id': 'req-b9a4fa37-0565-4544-b64f-6263e89241cf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:37.999109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa735c7282a4578a166fd4b98d2e3a3', 'request_id': 'req-b9a4fa37-0565-4544-b64f-6263e89241cf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.008477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa735c7282a4578a166fd4b98d2e3a3', 'request_id': 'req-b9a4fa37-0565-4544-b64f-6263e89241cf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.011558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 854/1705] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:37 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:38.021971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] The token cache is being invalidate because project 5fa735c7282a4578a166fd4b98d2e3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:38.022311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.024217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b9a4fa37-0565-4544-b64f-6263e89241cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.026241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 852/1706] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:37 2021] DELETE /identity/v3/projects/5fa735c7282a4578a166fd4b98d2e3a3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:38.038086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.038086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.038086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.056418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:38.059220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.141376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 855/1707] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:38.149720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545870b2-de6d-46ae-8a39-ab4ee76cca40 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.150239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545870b2-de6d-46ae-8a39-ab4ee76cca40 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.150335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545870b2-de6d-46ae-8a39-ab4ee76cca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.162728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.164576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.179395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd7d5f-0eda-40f2-a973-5aa819fc182d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.185968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.186920 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.187672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.187672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] PATH_INFO: `/v3/users/fb7d8ce180a14bb88c348cbc3471e118` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.188915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7d8ce180a14bb88c348cbc3471e118)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.191015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.192955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-545870b2-de6d-46ae-8a39-ab4ee76cca40 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:38.194250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-545870b2-de6d-46ae-8a39-ab4ee76cca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.202910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 853/1708] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:38.208846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545870b2-de6d-46ae-8a39-ab4ee76cca40 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.219062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545870b2-de6d-46ae-8a39-ab4ee76cca40 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.224363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.225035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.225463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.225794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.226634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:38.226966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.229568 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.243838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 854/1709] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:38.256432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.257503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7d8ce180a14bb88c348cbc3471e118'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.269978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5b3e0-bbc2-47b4-ab26-fa1bad110052 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.274551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7d8ce180a14bb88c348cbc3471e118'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.277748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.278771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.279409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.279881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.281330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.283294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7d8ce180a14bb88c348cbc3471e118'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.284129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7d8ce180a14bb88c348cbc3471e118'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.285936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.296339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1982a45d-5f5b-4a9f-80b9-0d36f3b43d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7d8ce180a14bb88c348cbc3471e118'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:38.312819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 856/1710] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:38 2021] DELETE /identity/v3/users/fb7d8ce180a14bb88c348cbc3471e118 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:38.317699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.318931 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.319244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.340243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 855/1711] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:38 2021] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:38.344704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.345307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:38.346438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.346573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.448328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776c32-a415-4dcf-ae59-e5f83da458df admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.448955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 857/1712] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:38.456498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.456903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.457261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.457612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.458421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.459074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.460870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.463976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.500632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 856/1713] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:38 2021] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:38.504802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.517226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527c91-1bb5-443b-87b6-acbc55e44549 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.531742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.536432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.536755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af36ac5-6366-44ae-8242-b50f5edecae2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.536877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.537246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.538091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.541262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.541543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.542244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.542531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.542804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.554126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.556675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 857/1714] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:38 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:38.556872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.560936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.590338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8bc4-b654-4629-92f8-5e6eb4d4d51a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.591093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 858/1715] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:29:38.597061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08a669-4d54-456d-a283-490ce195644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.597608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a669-4d54-456d-a283-490ce195644c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.597988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a669-4d54-456d-a283-490ce195644c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.598362 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08a669-4d54-456d-a283-490ce195644c admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.599201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08a669-4d54-456d-a283-490ce195644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.602888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08a669-4d54-456d-a283-490ce195644c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.615306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 858/1716] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:38 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:38.619762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.642085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621999-127c-4577-b70e-fed7637fbe93 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.647238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.648538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.648821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.649093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] PATH_INFO: `/v3/projects/9964d17283ab4b8d8f347eaae1e0d7e9/users/ffdfb416719a488eae23235289e9855e/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.666507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9964d17283ab4b8d8f347eaae1e0d7e9, user_id=ffdfb416719a488eae23235289e9855e, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.669804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.703970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 859/1717] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:38 2021] PUT /identity/v3/projects/9964d17283ab4b8d8f347eaae1e0d7e9/users/ffdfb416719a488eae23235289e9855e/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:38.714189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.714613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.715030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.754881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] MFA Rules not processed for user `ffdfb416719a488eae23235289e9855e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:38.756292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.845450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 859/1718] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:38 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:38.857168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:38.859238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:38.935685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61fcf-48f6-4d62-995d-2680d0bb25cc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:38.940541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:38.941323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:38.941635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:38.941926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:38.951197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:38.952834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:38.967547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 860/1719] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:38 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:39.130920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:39.133055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:39.233306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78de20-2bd6-40e1-b754-2892f64b4139 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:39.247000 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:39.248045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:39.248372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:39.248732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] PATH_INFO: `/v3/projects/bc6dc913cb414a64a6aef6702da14f52` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:39.250824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6dc913cb414a64a6aef6702da14f52)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:39.253229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:39.339272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6dc913cb414a64a6aef6702da14f52', 'request_id': 'req-4e7de11b-7166-4185-9e00-ead723529954'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.346502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6dc913cb414a64a6aef6702da14f52', 'request_id': 'req-4e7de11b-7166-4185-9e00-ead723529954'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.353684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6dc913cb414a64a6aef6702da14f52', 'request_id': 'req-4e7de11b-7166-4185-9e00-ead723529954'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.380576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] The token cache is being invalidate because project bc6dc913cb414a64a6aef6702da14f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:39.382011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.396505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.396505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 860/1720] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:39 2021] DELETE /identity/v3/projects/bc6dc913cb414a64a6aef6702da14f52 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:39.405737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:39.421700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daf499-34e0-4c9a-992f-df58148cad42 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:39.532240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:39.533434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:39.534784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:39.535071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] PATH_INFO: `/v3/users/6c5b841bb8d04b06b195b8583ba58a64` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:39.536887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5b841bb8d04b06b195b8583ba58a64)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:39.543420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:39.599041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5b841bb8d04b06b195b8583ba58a64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.610987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5b841bb8d04b06b195b8583ba58a64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.618453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5b841bb8d04b06b195b8583ba58a64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.619175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5b841bb8d04b06b195b8583ba58a64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.626466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-58b6558f-a62b-4313-9110-d3c8517bf432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5b841bb8d04b06b195b8583ba58a64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:39.633195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 861/1721] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:29:39 2021] DELETE /identity/v3/users/6c5b841bb8d04b06b195b8583ba58a64 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:40.060612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.062475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:40.086779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de11b-7166-4185-9e00-ead723529954 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.196984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.197872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.198154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.198432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] PATH_INFO: `/v3/projects/5b406c3775de4b9386b024becd8db2c0` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.199755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b406c3775de4b9386b024becd8db2c0)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.202004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:40.278126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b406c3775de4b9386b024becd8db2c0', 'request_id': 'req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:40.284417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b406c3775de4b9386b024becd8db2c0', 'request_id': 'req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:40.291003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b406c3775de4b9386b024becd8db2c0', 'request_id': 'req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:40.307311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] The token cache is being invalidate because project 5b406c3775de4b9386b024becd8db2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:29:40.307662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:40.308283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f6c4a29c-d3b0-459b-ae96-5ffddaff2baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:29:40.309859 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 861/1722] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:29:40 2021] DELETE /identity/v3/projects/5b406c3775de4b9386b024becd8db2c0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:40.316356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0fe4-d0c8-4e13-8b63-f290b8b9cb09 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.317174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0fe4-d0c8-4e13-8b63-f290b8b9cb09 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.317325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0fe4-d0c8-4e13-8b63-f290b8b9cb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.336111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1cda0fe4-d0c8-4e13-8b63-f290b8b9cb09 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:40.337421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1cda0fe4-d0c8-4e13-8b63-f290b8b9cb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:40.407226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 862/1723] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:40.415674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5059-6f49-4d6e-9c4a-a52b19990b7c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.415963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5059-6f49-4d6e-9c4a-a52b19990b7c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.416236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5059-6f49-4d6e-9c4a-a52b19990b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.434713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0e3a5059-6f49-4d6e-9c4a-a52b19990b7c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:40.435942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0e3a5059-6f49-4d6e-9c4a-a52b19990b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:40.444072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 862/1724] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:40.449062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda0fe4-d0c8-4e13-8b63-f290b8b9cb09 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.459229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda0fe4-d0c8-4e13-8b63-f290b8b9cb09 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.467043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.467785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.468112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.468393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.469139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:29:40.469451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.471147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:40.485150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 863/1725] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:29:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:29:40.489735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a5059-6f49-4d6e-9c4a-a52b19990b7c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.499940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a5059-6f49-4d6e-9c4a-a52b19990b7c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.505212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.505881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.506198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.506477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.507191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.509184 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:40.550843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 863/1726] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:40 2021] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:40.551759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.568097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1650-45bf-4f3f-9f90-101ac8282ed5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.639257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.639973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.640256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.640531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.641227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.643176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:40.666858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 864/1727] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:40 2021] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:40.671502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.685224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a1755-5167-4e5a-8f3d-fe70e48d5901 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.695842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.695842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.695842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.695842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.696392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.696487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:40.715394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 864/1728] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:40 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:40.718457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.729123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd5cce-c92e-4adb-bba1-3f71c77d0124 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.733898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c53a2-e771-4761-b1f8-b1cc773e18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.734608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c53a2-e771-4761-b1f8-b1cc773e18e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.734918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c53a2-e771-4761-b1f8-b1cc773e18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.735232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c53a2-e771-4761-b1f8-b1cc773e18e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.736037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c53a2-e771-4761-b1f8-b1cc773e18e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.737829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c53a2-e771-4761-b1f8-b1cc773e18e1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:40.748638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 865/1729] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:40.754362 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.764530 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507866e-dfb4-4458-9fc2-9f6d4fafe1c9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.769818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.770633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.770881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.771145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] PATH_INFO: `/v3/projects/36a685ce46784679aca039c041feb60c/users/bdd3d2f38fb04c70b46dd51a2e47cf51/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.787773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a685ce46784679aca039c041feb60c, user_id=bdd3d2f38fb04c70b46dd51a2e47cf51, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.790935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:40.805690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 865/1730] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:40 2021] PUT /identity/v3/projects/36a685ce46784679aca039c041feb60c/users/bdd3d2f38fb04c70b46dd51a2e47cf51/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:29:40.817889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a4e5-98d2-4802-914d-90db899e8c47 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.818252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a4e5-98d2-4802-914d-90db899e8c47 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.818698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98a4e5-98d2-4802-914d-90db899e8c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.845104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-bc98a4e5-98d2-4802-914d-90db899e8c47 None None] MFA Rules not processed for user `bdd3d2f38fb04c70b46dd51a2e47cf51`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:40.846365 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-bc98a4e5-98d2-4802-914d-90db899e8c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:40.911267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 866/1731] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:40 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:40.916355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:40.982937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafe740-76b2-46bd-a4a1-dd5fefad5ddf admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:40.988123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:40.988782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:40.989062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:40.989338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:40.990020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:40.992182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.028205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 866/1732] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:40 2021] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:41.034559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98a4e5-98d2-4802-914d-90db899e8c47 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.047383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98a4e5-98d2-4802-914d-90db899e8c47 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.113234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.113912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.114197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.114480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.115166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.117327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.139499 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 867/1733] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:41 2021] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:41.143453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.154870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c36692-e8f5-471d-b107-50aa3efd6af0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.160250 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.160959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.161195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.161469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.162215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.164436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.178265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 867/1734] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:41.179566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.190349 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f66d3-575f-4b88-a962-18f61856a217 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.195221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8c17-18d0-43f9-b415-c3e7adc50b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.195932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8c17-18d0-43f9-b415-c3e7adc50b7f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.196214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8c17-18d0-43f9-b415-c3e7adc50b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.196520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8c17-18d0-43f9-b415-c3e7adc50b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.197242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8c17-18d0-43f9-b415-c3e7adc50b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.198872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8c17-18d0-43f9-b415-c3e7adc50b7f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.209153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 868/1735] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:29:41.213585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.224000 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d398-c1fe-40bf-8e74-14477fa1cfd0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.229313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.230266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.230546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.230858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] PATH_INFO: `/v3/projects/d07159852b3e4828918d3ef8bddc1cce/users/3e108f152de9476888389bfce64c581e/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.247582 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07159852b3e4828918d3ef8bddc1cce, user_id=3e108f152de9476888389bfce64c581e, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.250326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.265982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 868/1736] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:41 2021] PUT /identity/v3/projects/d07159852b3e4828918d3ef8bddc1cce/users/3e108f152de9476888389bfce64c581e/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:41.277715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ca0a-20a1-4a85-8651-4d27ad9c8f86 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.278005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ca0a-20a1-4a85-8651-4d27ad9c8f86 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.278337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633ca0a-20a1-4a85-8651-4d27ad9c8f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.304616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f633ca0a-20a1-4a85-8651-4d27ad9c8f86 None None] MFA Rules not processed for user `3e108f152de9476888389bfce64c581e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:41.306369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f633ca0a-20a1-4a85-8651-4d27ad9c8f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:41.382292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 869/1737] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:41 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:41.395770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.453489 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344cc61-01ef-44c9-8510-c08d7962b860 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.458119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.458779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.459061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.459334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.460200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.462167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.489309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 869/1738] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:29:41 2021] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:29:41.494180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ca0a-20a1-4a85-8651-4d27ad9c8f86 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.509852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633ca0a-20a1-4a85-8651-4d27ad9c8f86 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.573398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.574073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.574353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.574620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.575298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.577242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.598298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 870/1739] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:29:41 2021] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:29:41.602680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.613011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1eea2-9ede-4135-a56b-e53abde937c3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.618097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.618758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.619038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.619310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.620072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.621675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.632860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 870/1740] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:41.637063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.647770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682ac3-265a-4726-a8ad-d49be1538597 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.653503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.654487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.654770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.655146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] PATH_INFO: `/v3/projects/f2e12be5e90c4b069ea20eca58400981/users/9153f9a02e6441bfb5289a1aa06ac39c/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.670475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e12be5e90c4b069ea20eca58400981, user_id=9153f9a02e6441bfb5289a1aa06ac39c, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.673268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.687684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 871/1741] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:41 2021] PUT /identity/v3/projects/f2e12be5e90c4b069ea20eca58400981/users/9153f9a02e6441bfb5289a1aa06ac39c/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:41.691815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.702503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98883-c56c-43cf-8735-dabbd59d7f56 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.758404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d794-6fdd-4aa5-abf3-efd087ac4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.759076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d794-6fdd-4aa5-abf3-efd087ac4897 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.759379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d794-6fdd-4aa5-abf3-efd087ac4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.759651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d794-6fdd-4aa5-abf3-efd087ac4897 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.760371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d794-6fdd-4aa5-abf3-efd087ac4897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.761964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d794-6fdd-4aa5-abf3-efd087ac4897 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.771740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 871/1742] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:29:41 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:29:41.776169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.787075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51baf3-f2ca-4393-a3cc-5996f17439c4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:41.792598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:41.793488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.793774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.794049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] PATH_INFO: `/v3/projects/f2e12be5e90c4b069ea20eca58400981/users/9153f9a02e6441bfb5289a1aa06ac39c/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.796399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e12be5e90c4b069ea20eca58400981, user_id=9153f9a02e6441bfb5289a1aa06ac39c, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:41.799030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:41.810043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 872/1743] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:29:41 2021] PUT /identity/v3/projects/f2e12be5e90c4b069ea20eca58400981/users/9153f9a02e6441bfb5289a1aa06ac39c/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:29:41.820965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:41.821326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:41.821694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:41.851498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] MFA Rules not processed for user `9153f9a02e6441bfb5289a1aa06ac39c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:41.852700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:41.938163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 872/1744] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:29:41 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:29:41.949062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:41.951009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:42.010927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4d642-34a5-4b63-a49c-16cdf63bf6a4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:42.015095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719c420-83f6-4107-bc71-f3ee9bf73757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:42.015780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c420-83f6-4107-bc71-f3ee9bf73757 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:42.016091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c420-83f6-4107-bc71-f3ee9bf73757 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:42.016383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c420-83f6-4107-bc71-f3ee9bf73757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:42.026536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719c420-83f6-4107-bc71-f3ee9bf73757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:42.028045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719c420-83f6-4107-bc71-f3ee9bf73757 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:42.039731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 873/1745] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:41 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:42.089146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:42.091303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:42.110099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9becb-ef3b-45f6-92db-d33f23bf44dc None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:42.116865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:42.117497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:42.117906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:42.118342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:42.179312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:42.181064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:42.190954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 873/1746] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:42 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:43.353759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:43.354269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:43.354387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:43.373533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] MFA Rules not processed for user `3357ca71ec4443f8a9fba9b7ac4cfdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:43.374761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:43.435007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 874/1747] 10.222.0.63 () {58 vars in 1016 bytes} [Fri Aug 27 03:29:43 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:43.490483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:43.490969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:43.492536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:43.492981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:43.502839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b7637-6128-4d8b-9857-1801a6e0a281 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:43.504779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b9d29-ed88-4b9d-8b09-a900c9e36978 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:43.507245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9672ef-2757-4aea-85e4-da12f64a0f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:43.508110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9672ef-2757-4aea-85e4-da12f64a0f82 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:43.508396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9672ef-2757-4aea-85e4-da12f64a0f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:43.508788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c7fde-0e85-4eb3-8cb7-7a19e5e02a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:43.508899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9672ef-2757-4aea-85e4-da12f64a0f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:43.509513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c7fde-0e85-4eb3-8cb7-7a19e5e02a8c service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:43.509797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c7fde-0e85-4eb3-8cb7-7a19e5e02a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:43.510073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c7fde-0e85-4eb3-8cb7-7a19e5e02a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:43.517381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9672ef-2757-4aea-85e4-da12f64a0f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:43.517965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c7fde-0e85-4eb3-8cb7-7a19e5e02a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:43.519014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9672ef-2757-4aea-85e4-da12f64a0f82 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:43.519429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c7fde-0e85-4eb3-8cb7-7a19e5e02a8c service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:43.527724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 874/1748] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:43 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:43.528294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 875/1749] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:43 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:44.276528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba151ce-f997-4ab5-a83d-39110bb9f971 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:44.277017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba151ce-f997-4ab5-a83d-39110bb9f971 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:44.277449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba151ce-f997-4ab5-a83d-39110bb9f971 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:44.279727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 875/1750] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:29:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:44.290814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852673d0-3891-4244-8822-c3d78673597d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:44.291108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852673d0-3891-4244-8822-c3d78673597d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:44.291423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852673d0-3891-4244-8822-c3d78673597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:44.320551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-852673d0-3891-4244-8822-c3d78673597d None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:44.321952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-852673d0-3891-4244-8822-c3d78673597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:44.408907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 876/1751] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:29:44 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:44.422936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba151ce-f997-4ab5-a83d-39110bb9f971 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:44.424751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-aba151ce-f997-4ab5-a83d-39110bb9f971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:44.443230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba151ce-f997-4ab5-a83d-39110bb9f971 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:44.453991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642df5-aca1-44b4-81d3-a0d587f55401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:44.454857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642df5-aca1-44b4-81d3-a0d587f55401 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:44.455276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642df5-aca1-44b4-81d3-a0d587f55401 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:44.455727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642df5-aca1-44b4-81d3-a0d587f55401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:44.467025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642df5-aca1-44b4-81d3-a0d587f55401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:44.468664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642df5-aca1-44b4-81d3-a0d587f55401 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:44.479679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 876/1752] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:29:44.511821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceb7c7-0420-4ef8-92c6-dc355b47f526 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:44.512122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceb7c7-0420-4ef8-92c6-dc355b47f526 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:44.512392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceb7c7-0420-4ef8-92c6-dc355b47f526 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:44.514413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 877/1753] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:29:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:29:44.523928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5273ce-867b-4e30-b20e-9c5b9bbedc16 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:44.524434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5273ce-867b-4e30-b20e-9c5b9bbedc16 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:44.524434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5273ce-867b-4e30-b20e-9c5b9bbedc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:44.544344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-fe5273ce-867b-4e30-b20e-9c5b9bbedc16 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:29:44.545671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-fe5273ce-867b-4e30-b20e-9c5b9bbedc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:44.556839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 877/1754] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:29:44 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:29:44.569362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceb7c7-0420-4ef8-92c6-dc355b47f526 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:29:44.571815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-82ceb7c7-0420-4ef8-92c6-dc355b47f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:29:44.589903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceb7c7-0420-4ef8-92c6-dc355b47f526 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:29:44.595591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fb97f-74d0-4c82-94aa-c37898d7ea59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:29:44.596235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fb97f-74d0-4c82-94aa-c37898d7ea59 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:29:44.596517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fb97f-74d0-4c82-94aa-c37898d7ea59 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:29:44.596790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fb97f-74d0-4c82-94aa-c37898d7ea59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:29:44.606225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fb97f-74d0-4c82-94aa-c37898d7ea59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:29:44.607832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fb97f-74d0-4c82-94aa-c37898d7ea59 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:29:44.618738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 878/1755] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:29:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:01.019576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5273ce-867b-4e30-b20e-9c5b9bbedc16 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:01.096212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5273ce-867b-4e30-b20e-9c5b9bbedc16 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:01.100967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:01.101846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:01.102125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:01.102397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] PATH_INFO: `/v3/users/bdd3d2f38fb04c70b46dd51a2e47cf51` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:01.103723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd3d2f38fb04c70b46dd51a2e47cf51)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:01.106131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:01.155983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd3d2f38fb04c70b46dd51a2e47cf51'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.164336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd3d2f38fb04c70b46dd51a2e47cf51'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.164988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd3d2f38fb04c70b46dd51a2e47cf51'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.178603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd3d2f38fb04c70b46dd51a2e47cf51'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.179548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd3d2f38fb04c70b46dd51a2e47cf51'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.194485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 878/1756] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:01 2021] DELETE /identity/v3/users/bdd3d2f38fb04c70b46dd51a2e47cf51 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:01.199394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:01.200529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:01.201039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:01.218867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:01.220217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:01.285139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 879/1757] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:01.296093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:01.297512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:01.359133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa5fe-403d-4e74-8b39-62b51165db6b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:01.363315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:01.363998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:01.364283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:01.364603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:01.375449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:01.377023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:01.388973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 879/1758] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:01.715383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:01.717444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:01.737909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4af0b5-0795-427c-bf46-4a9640400444 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:01.745637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:01.747523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:01.748023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:01.748664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] PATH_INFO: `/v3/projects/36a685ce46784679aca039c041feb60c` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:01.753116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a685ce46784679aca039c041feb60c)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:01.756334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:01.816451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a685ce46784679aca039c041feb60c', 'request_id': 'req-ac5c846f-96c0-4a83-9983-7576df97fb64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.825014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a685ce46784679aca039c041feb60c', 'request_id': 'req-ac5c846f-96c0-4a83-9983-7576df97fb64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.834558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a685ce46784679aca039c041feb60c', 'request_id': 'req-ac5c846f-96c0-4a83-9983-7576df97fb64'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.846645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] The token cache is being invalidate because project 36a685ce46784679aca039c041feb60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:01.847227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.848027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:01.849843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 880/1759] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:01 2021] DELETE /identity/v3/projects/36a685ce46784679aca039c041feb60c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:01.853950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:01.864792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebdb4d-66e6-4fbf-b1af-2cdda9d1d049 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:01.981908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:01.982798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:01.983080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:01.983415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] PATH_INFO: `/v3/users/3e108f152de9476888389bfce64c581e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:01.984703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e108f152de9476888389bfce64c581e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:01.987160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:02.072084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e108f152de9476888389bfce64c581e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.079774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e108f152de9476888389bfce64c581e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.080714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e108f152de9476888389bfce64c581e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.094418 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e108f152de9476888389bfce64c581e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.095259 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e108f152de9476888389bfce64c581e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.111736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 880/1760] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:01 2021] DELETE /identity/v3/users/3e108f152de9476888389bfce64c581e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:02.524883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:02.527614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:02.565283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c846f-96c0-4a83-9983-7576df97fb64 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:02.680158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:02.681494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:02.682162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:02.682623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] PATH_INFO: `/v3/projects/d07159852b3e4828918d3ef8bddc1cce` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:02.686796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07159852b3e4828918d3ef8bddc1cce)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:02.689003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:02.766342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07159852b3e4828918d3ef8bddc1cce', 'request_id': 'req-317208b4-aaae-404f-baec-90bd41d01952'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.774062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07159852b3e4828918d3ef8bddc1cce', 'request_id': 'req-317208b4-aaae-404f-baec-90bd41d01952'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.782711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07159852b3e4828918d3ef8bddc1cce', 'request_id': 'req-317208b4-aaae-404f-baec-90bd41d01952'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.793984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] The token cache is being invalidate because project d07159852b3e4828918d3ef8bddc1cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:02.794384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.795041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.796708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 881/1761] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:02 2021] DELETE /identity/v3/projects/d07159852b3e4828918d3ef8bddc1cce => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:02.800999 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:02.802485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:02.816404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fc4b3-c1aa-4299-b70a-6a619368a8eb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:02.877536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:02.878453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:02.878736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:02.879028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] PATH_INFO: `/v3/users/9153f9a02e6441bfb5289a1aa06ac39c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:02.880241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9153f9a02e6441bfb5289a1aa06ac39c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:02.882478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:02.946101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9153f9a02e6441bfb5289a1aa06ac39c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.954366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9153f9a02e6441bfb5289a1aa06ac39c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.954366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9153f9a02e6441bfb5289a1aa06ac39c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.968945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9153f9a02e6441bfb5289a1aa06ac39c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.969670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9153f9a02e6441bfb5289a1aa06ac39c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:02.986395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 881/1762] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:02 2021] DELETE /identity/v3/users/9153f9a02e6441bfb5289a1aa06ac39c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:03.113323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.114815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:03.136641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317208b4-aaae-404f-baec-90bd41d01952 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.241906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.242767 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.243654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.244213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] PATH_INFO: `/v3/users/ef4487d363c54672918c197b6c8550ce` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.245845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4487d363c54672918c197b6c8550ce)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.248616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.327085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4487d363c54672918c197b6c8550ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.353092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4487d363c54672918c197b6c8550ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.371423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4487d363c54672918c197b6c8550ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.372183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4487d363c54672918c197b6c8550ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.385126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-470bd1cb-bfb2-4c59-b29a-9d7c66dd0479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4487d363c54672918c197b6c8550ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.385870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.388075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:03.402014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 882/1763] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:03 2021] DELETE /identity/v3/users/ef4487d363c54672918c197b6c8550ce => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:03.406523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.406797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.407080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.412477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e65a-8f46-4cd2-97e2-0b74618c2041 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.451848 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:03.456509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:03.487073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.488025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.488241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.488513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] PATH_INFO: `/v3/projects/f2e12be5e90c4b069ea20eca58400981` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.489686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e12be5e90c4b069ea20eca58400981)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.491684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.515487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 883/1764] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:03.527271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.528664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:03.536782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e12be5e90c4b069ea20eca58400981', 'request_id': 'req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.543038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e12be5e90c4b069ea20eca58400981', 'request_id': 'req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.549269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e12be5e90c4b069ea20eca58400981', 'request_id': 'req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.563813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] The token cache is being invalidate because project f2e12be5e90c4b069ea20eca58400981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:03.564227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.564970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e5aafdf4-9f26-4e2b-97b5-6f85c1c1529c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:03.566712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 882/1765] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:03 2021] DELETE /identity/v3/projects/f2e12be5e90c4b069ea20eca58400981 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:03.574090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536d75-d448-43c2-8dca-74bcdcbd5efd None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.574457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536d75-d448-43c2-8dca-74bcdcbd5efd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.574831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d536d75-d448-43c2-8dca-74bcdcbd5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.586597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1d5d2-6d9a-43ab-83eb-15a4bb8694b4 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.594980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8d536d75-d448-43c2-8dca-74bcdcbd5efd None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:03.596236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8d536d75-d448-43c2-8dca-74bcdcbd5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:03.638444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.639125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.640778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.641060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.643836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:03.665880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 883/1766] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:03.675268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c04162-9f7c-47a6-b102-9451d2351010 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.675584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c04162-9f7c-47a6-b102-9451d2351010 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.675869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c04162-9f7c-47a6-b102-9451d2351010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.699377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-02c04162-9f7c-47a6-b102-9451d2351010 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:03.700749 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-02c04162-9f7c-47a6-b102-9451d2351010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:03.709769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 884/1767] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:03.710516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.711989 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.714602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c04162-9f7c-47a6-b102-9451d2351010 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.721682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 884/1768] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:03.724884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c04162-9f7c-47a6-b102-9451d2351010 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.731067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.731993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.732375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.732778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.733908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:03.734211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.735837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.747555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 885/1769] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:30:03.753265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.763252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190222-5737-4a6a-99b2-3d48e7ae297a service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.768744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.769591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.770404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.770404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.772157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.773263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.805441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 885/1770] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:03 2021] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:03.807949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.821631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ffb4-dc9b-4906-b0dc-7f753459dd2c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.882668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.883553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.883882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.884198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.884980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.887658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.908760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 886/1771] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:03 2021] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:03.913542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.924633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35af16-7a23-482f-b729-fa05e4a98fd2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.930724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.931497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.931848 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.932232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.933033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.934797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.947035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 886/1772] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:03.951109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:03.962265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ac726-6a75-4f06-a0b5-cfdba619cd67 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:03.968922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784b8fd-0055-4c88-902b-c5e4fe339520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:03.969963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784b8fd-0055-4c88-902b-c5e4fe339520 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:03.970355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784b8fd-0055-4c88-902b-c5e4fe339520 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:03.970685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784b8fd-0055-4c88-902b-c5e4fe339520 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:03.971789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784b8fd-0055-4c88-902b-c5e4fe339520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:03.973962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784b8fd-0055-4c88-902b-c5e4fe339520 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:03.986372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 887/1773] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:03.990813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.001937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b854-04ca-469e-bc08-7b548f9aecbf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.008264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.009244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.009595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.009937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] PATH_INFO: `/v3/projects/032fd5188c9a49ff8168dce91348de76/users/c31b013db08748f4b02096a6ab0f2571/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.030377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032fd5188c9a49ff8168dce91348de76, user_id=c31b013db08748f4b02096a6ab0f2571, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.033954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.066848 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 887/1774] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:03 2021] PUT /identity/v3/projects/032fd5188c9a49ff8168dce91348de76/users/c31b013db08748f4b02096a6ab0f2571/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:04.082506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf66c-78b0-470d-b679-e591fe93119a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.082856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf66c-78b0-470d-b679-e591fe93119a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.083158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf66c-78b0-470d-b679-e591fe93119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.110517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-fb9bf66c-78b0-470d-b679-e591fe93119a None None] MFA Rules not processed for user `c31b013db08748f4b02096a6ab0f2571`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:04.111795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-fb9bf66c-78b0-470d-b679-e591fe93119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:04.174770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.176685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:04.197802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 888/1775] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:04 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:04.198760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bf66c-78b0-470d-b679-e591fe93119a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.272231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bf66c-78b0-470d-b679-e591fe93119a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.277473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.278232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.278440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.278717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.279437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.281363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.315533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b7b31-77bb-4e9b-b3a3-79ed040d9934 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.320424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 889/1776] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:04 2021] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:04.324073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.324463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.325009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.325296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.325573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] PATH_INFO: `/v3/projects/ea8cbbec7fac4e74a3eb75839aaf51a9` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.326837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8cbbec7fac4e74a3eb75839aaf51a9)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.328879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.390292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8cbbec7fac4e74a3eb75839aaf51a9', 'request_id': 'req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.399604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c054edb-3c70-45bf-89eb-73d0a9c1557a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.403461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8cbbec7fac4e74a3eb75839aaf51a9', 'request_id': 'req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.415504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8cbbec7fac4e74a3eb75839aaf51a9', 'request_id': 'req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.426045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] The token cache is being invalidate because project ea8cbbec7fac4e74a3eb75839aaf51a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:04.426341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.427984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.430609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 888/1777] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:04 2021] DELETE /identity/v3/projects/ea8cbbec7fac4e74a3eb75839aaf51a9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:04.434271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.435698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:04.473350 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.474206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.474495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.474806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.475802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.477994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.512414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 890/1778] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:04 2021] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:04.512591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4c32f-1cdc-4012-a344-c0682b6ee89f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.516096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.516096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.516096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.516096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] PATH_INFO: `/v3/users/3f36f17a4e5e48ddab52828fd0e88510` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.517165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f36f17a4e5e48ddab52828fd0e88510)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.517586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.519128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.519723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:04.531860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c943299-2497-4a32-95dc-ebd0190e7a40 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.537286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.538124 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.538470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.538890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.539669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.541321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.552108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 891/1779] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:04.557784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.568333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bedf25-0920-41ee-95fb-574e61dcacdc admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.571537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f36f17a4e5e48ddab52828fd0e88510'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.573895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.574857 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.575134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.575436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] PATH_INFO: `/v3/projects/c314cdd56d9f41259b9877fa197d9f94/users/f191cd4e57af443ab9af259fe4de16be/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.586543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f36f17a4e5e48ddab52828fd0e88510'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.590614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c314cdd56d9f41259b9877fa197d9f94, user_id=f191cd4e57af443ab9af259fe4de16be, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.593296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.594092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f36f17a4e5e48ddab52828fd0e88510'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.594771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f36f17a4e5e48ddab52828fd0e88510'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.603343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f36f17a4e5e48ddab52828fd0e88510'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:04.608440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 892/1780] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:04 2021] PUT /identity/v3/projects/c314cdd56d9f41259b9877fa197d9f94/users/f191cd4e57af443ab9af259fe4de16be/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:04.610034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 889/1781] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:04 2021] DELETE /identity/v3/users/3f36f17a4e5e48ddab52828fd0e88510 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:04.612876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.614773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:04.699637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838f707-dd85-422a-9691-b4fb91cf7fdb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.764983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638c71b-b1cf-4a47-a3c8-6b80e3fe1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.765792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638c71b-b1cf-4a47-a3c8-6b80e3fe1ecd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.766210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638c71b-b1cf-4a47-a3c8-6b80e3fe1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.766495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638c71b-b1cf-4a47-a3c8-6b80e3fe1ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.767492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638c71b-b1cf-4a47-a3c8-6b80e3fe1ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.773001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638c71b-b1cf-4a47-a3c8-6b80e3fe1ecd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.799593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 893/1782] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:04 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:04.800400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.810081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea00c-74ea-47e5-920f-43ff820ddb7d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:04.815663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:04.816382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.816656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.816929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] PATH_INFO: `/v3/projects/c314cdd56d9f41259b9877fa197d9f94/users/f191cd4e57af443ab9af259fe4de16be/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.819305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c314cdd56d9f41259b9877fa197d9f94, user_id=f191cd4e57af443ab9af259fe4de16be, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:04.822025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:04.834439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 890/1783] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:04 2021] PUT /identity/v3/projects/c314cdd56d9f41259b9877fa197d9f94/users/f191cd4e57af443ab9af259fe4de16be/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:04.845359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:04.845855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:04.846142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:04.875701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] MFA Rules not processed for user `f191cd4e57af443ab9af259fe4de16be`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:04.876931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:04.937785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.939678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:04.956659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 894/1784] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:04 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:04.970337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:04.972235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.006193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a1599-e570-44d3-956f-a69ff1c3590a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.011533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.012431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.012828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.013132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] PATH_INFO: `/v3/projects/f058f56a6d8349bca32ec7cee13cffd8` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.014353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f058f56a6d8349bca32ec7cee13cffd8)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.016362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.025981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76144b52-9b65-4fb6-9e4c-c7c6a6fed4fe None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.029591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7762e7-9b7a-44b3-abcb-3e826a8d3d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.030237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7762e7-9b7a-44b3-abcb-3e826a8d3d67 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.030517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7762e7-9b7a-44b3-abcb-3e826a8d3d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.030785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7762e7-9b7a-44b3-abcb-3e826a8d3d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.039661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7762e7-9b7a-44b3-abcb-3e826a8d3d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.041096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7762e7-9b7a-44b3-abcb-3e826a8d3d67 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.051371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 895/1785] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:04 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:05.066512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f058f56a6d8349bca32ec7cee13cffd8', 'request_id': 'req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.074750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f058f56a6d8349bca32ec7cee13cffd8', 'request_id': 'req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.085054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f058f56a6d8349bca32ec7cee13cffd8', 'request_id': 'req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.098876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] The token cache is being invalidate because project f058f56a6d8349bca32ec7cee13cffd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:05.099229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.099876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8bf4d819-3cc8-4c6a-b9b4-75cd8cf66329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.101954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 891/1786] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:04 2021] DELETE /identity/v3/projects/f058f56a6d8349bca32ec7cee13cffd8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:05.107503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba5e9-4e72-48fe-8701-efc4128170d4 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.107791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba5e9-4e72-48fe-8701-efc4128170d4 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.108099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba5e9-4e72-48fe-8701-efc4128170d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.127008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-620ba5e9-4e72-48fe-8701-efc4128170d4 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:05.128240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-620ba5e9-4e72-48fe-8701-efc4128170d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.195781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 896/1787] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:05.204681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fe09-3307-4cf0-b491-07788716077d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.204681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fe09-3307-4cf0-b491-07788716077d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.204681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6fe09-3307-4cf0-b491-07788716077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.227132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-2da6fe09-3307-4cf0-b491-07788716077d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:05.227132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2da6fe09-3307-4cf0-b491-07788716077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.237167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 892/1788] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:05.238566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ba5e9-4e72-48fe-8701-efc4128170d4 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.248334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ba5e9-4e72-48fe-8701-efc4128170d4 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.253913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.255311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.255791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.256246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.258084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:05.258655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.261389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.275428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 897/1789] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:05.279379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6fe09-3307-4cf0-b491-07788716077d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.289310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6fe09-3307-4cf0-b491-07788716077d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.298720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.300277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.300910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.301392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.302288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.305771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.335846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 893/1790] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:05.339956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.349983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9fefd-7a78-45ff-bc83-1bd19019bd53 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.406289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.406966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.407276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.407690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.408398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.410339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.433192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 898/1791] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:05.437123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.448567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da888249-830d-4780-b88a-18f588e7eb43 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.454239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.455062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.455383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.455683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.456389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.458028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.470644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 894/1792] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:05 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:05.478353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.486214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05759c70-a1f1-4ce0-995d-cf695593c9f5 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.491207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74d3aa-197a-46e7-bf3f-28ee3fc43087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.492181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74d3aa-197a-46e7-bf3f-28ee3fc43087 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.492375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74d3aa-197a-46e7-bf3f-28ee3fc43087 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.492656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74d3aa-197a-46e7-bf3f-28ee3fc43087 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.493512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74d3aa-197a-46e7-bf3f-28ee3fc43087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.495156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74d3aa-197a-46e7-bf3f-28ee3fc43087 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.509388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 899/1793] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:05 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:05.510727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.521010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79999d-3b46-4523-8cf8-846be8dbbfc7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.526461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.527413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.527677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.527948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] PATH_INFO: `/v3/projects/c5e857d826c54cc0b3edcade22b2d293/users/904403649ee74ca1aaff7dc1dcb48c34/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.543752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e857d826c54cc0b3edcade22b2d293, user_id=904403649ee74ca1aaff7dc1dcb48c34, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.546524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.562037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 895/1794] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:05 2021] PUT /identity/v3/projects/c5e857d826c54cc0b3edcade22b2d293/users/904403649ee74ca1aaff7dc1dcb48c34/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:05.576065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.576065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.576065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.604889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] MFA Rules not processed for user `904403649ee74ca1aaff7dc1dcb48c34`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:05.606313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.677586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 900/1795] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:05.682458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.691496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.693197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.749550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a191ce-be1f-406d-b9cc-5e77930ba9da admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.756319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.757546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.758020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.758352 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.760491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.761449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.774566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690a39-f652-4124-b7da-82ae99db135b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.780171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.781275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.781635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.781943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] PATH_INFO: `/v3/users/c31b013db08748f4b02096a6ab0f2571` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.783318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31b013db08748f4b02096a6ab0f2571)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.785788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.791503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 896/1796] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:05.795507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.834068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31b013db08748f4b02096a6ab0f2571'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.841008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31b013db08748f4b02096a6ab0f2571'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.841809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31b013db08748f4b02096a6ab0f2571'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.853731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31b013db08748f4b02096a6ab0f2571'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.854596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-eddd9d44-bd92-4de2-92e0-2b24ee8c30f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31b013db08748f4b02096a6ab0f2571'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:05.859973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88816543-483f-4532-b03d-bbacb8129e55 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.865136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.865951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.866194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.866407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.867096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.871187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 901/1797] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:05 2021] DELETE /identity/v3/users/c31b013db08748f4b02096a6ab0f2571 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:05.871482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:05.873274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.873635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.874008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.890641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 897/1798] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:05.891528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:05.892730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.896151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.898254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.912160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd3434-ffb8-4c9e-a15b-f90c7318f661 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:05.953512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 902/1799] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:05.964905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:05.966862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:05.993905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:05.994664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:05.995017 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:05.995427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:05.996654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:05.998952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.034055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 898/1800] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:05 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:06.043889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba29e8-2f2c-4345-a8a0-47400ea25ad3 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.047606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:06.060025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.060740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.061028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.061434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.066359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e1c4-d28a-4a37-b40b-6cee934f8522 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.072863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.075374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.086395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.087101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 903/1801] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:06.087339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.091883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.092234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] PATH_INFO: `/v3/projects/eb2970fe74754ac2a4db9e96ae4384a2/users/a7b4c881f562405b85cb0965c55a8ffa/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.128187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2970fe74754ac2a4db9e96ae4384a2, user_id=a7b4c881f562405b85cb0965c55a8ffa, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.131410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.156727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 899/1802] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:06 2021] PUT /identity/v3/projects/eb2970fe74754ac2a4db9e96ae4384a2/users/a7b4c881f562405b85cb0965c55a8ffa/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:06.160856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:06.180602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c5c0-457f-4c00-8b9a-417f05e1aab7 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.277417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe764f11-b2bf-47b7-8201-abc02eab5275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.278233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764f11-b2bf-47b7-8201-abc02eab5275 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.278571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764f11-b2bf-47b7-8201-abc02eab5275 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.278873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe764f11-b2bf-47b7-8201-abc02eab5275 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.279803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe764f11-b2bf-47b7-8201-abc02eab5275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.282067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe764f11-b2bf-47b7-8201-abc02eab5275 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.302221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:06.303565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 904/1803] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:06 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:06.319063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7e283-d2b0-451c-b9f9-f78dd82ce396 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.325265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.326236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.326652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.326988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] PATH_INFO: `/v3/projects/eb2970fe74754ac2a4db9e96ae4384a2/users/a7b4c881f562405b85cb0965c55a8ffa/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.330399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2970fe74754ac2a4db9e96ae4384a2, user_id=a7b4c881f562405b85cb0965c55a8ffa, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.333389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.348669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 900/1804] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:06 2021] PUT /identity/v3/projects/eb2970fe74754ac2a4db9e96ae4384a2/users/a7b4c881f562405b85cb0965c55a8ffa/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:06.360154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.360907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.361195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.420241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] MFA Rules not processed for user `a7b4c881f562405b85cb0965c55a8ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:06.422354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:06.533493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 905/1805] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:06 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:06.545817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:06.547675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:06.556438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:06.559722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:06.637494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac60e7-1513-4a30-b8fb-d9e1d190251f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.641737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.642468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.642803 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.643241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.669707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f20732-25b4-4e27-9f51-4fa28faa8956 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.673558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.676838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.680621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.682280 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.683687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.684246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] PATH_INFO: `/v3/projects/032fd5188c9a49ff8168dce91348de76` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.686174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032fd5188c9a49ff8168dce91348de76)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.690806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.695802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 901/1806] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:06 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:06.755336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:06.757863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:06.765188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032fd5188c9a49ff8168dce91348de76', 'request_id': 'req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.773541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032fd5188c9a49ff8168dce91348de76', 'request_id': 'req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.781883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032fd5188c9a49ff8168dce91348de76', 'request_id': 'req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.785438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eafc61-998c-4bc0-ae78-33ab8482b9e2 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.806354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] The token cache is being invalidate because project 032fd5188c9a49ff8168dce91348de76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:06.809591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.811086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.814388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 906/1807] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:06 2021] DELETE /identity/v3/projects/032fd5188c9a49ff8168dce91348de76 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:06.821348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:06.824062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:06.868096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.868856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.869142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.869442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.871523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:06.899430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa74cf3-a50f-4f08-bd4d-553fce5fa2a4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:06.908394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:06.909352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:06.909711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:06.910022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] PATH_INFO: `/v3/users/f191cd4e57af443ab9af259fe4de16be` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:06.911400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f191cd4e57af443ab9af259fe4de16be)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.913717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.949024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:06.950866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:06.961375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 902/1808] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:06 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:06.971160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f191cd4e57af443ab9af259fe4de16be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.978367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f191cd4e57af443ab9af259fe4de16be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.979069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f191cd4e57af443ab9af259fe4de16be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.990441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f191cd4e57af443ab9af259fe4de16be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:06.992165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1375c009-77f9-4de5-82b4-994fface2b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f191cd4e57af443ab9af259fe4de16be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:07.005858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 907/1809] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:06 2021] DELETE /identity/v3/users/f191cd4e57af443ab9af259fe4de16be => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:07.318035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:07.328766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874b780-58ff-480d-a9b0-d723a05a00c6 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:07.393169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:07.393963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.394247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.394523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] PATH_INFO: `/v3/projects/c314cdd56d9f41259b9877fa197d9f94` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.395825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c314cdd56d9f41259b9877fa197d9f94)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:07.398001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:07.450612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c314cdd56d9f41259b9877fa197d9f94', 'request_id': 'req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:07.456706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c314cdd56d9f41259b9877fa197d9f94', 'request_id': 'req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:07.466218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c314cdd56d9f41259b9877fa197d9f94', 'request_id': 'req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:07.477164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] The token cache is being invalidate because project c314cdd56d9f41259b9877fa197d9f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:07.477449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:07.478098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0d1be782-5cb8-4aef-998d-d10bacc1bbb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:07.479736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 903/1810] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:07 2021] DELETE /identity/v3/projects/c314cdd56d9f41259b9877fa197d9f94 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:07.485998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eabdd-d865-49c6-ac93-114371abfd1d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.486478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eabdd-d865-49c6-ac93-114371abfd1d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.486567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eabdd-d865-49c6-ac93-114371abfd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.507445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2b2eabdd-d865-49c6-ac93-114371abfd1d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:07.508650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2b2eabdd-d865-49c6-ac93-114371abfd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:07.573367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 908/1811] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:07.581511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e9dc-4da8-42b5-bc94-e378a89545a3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.581806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e9dc-4da8-42b5-bc94-e378a89545a3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.582136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e9dc-4da8-42b5-bc94-e378a89545a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.603884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-38c2e9dc-4da8-42b5-bc94-e378a89545a3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:07.605102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-38c2e9dc-4da8-42b5-bc94-e378a89545a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:07.621047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 904/1812] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:07.625304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eabdd-d865-49c6-ac93-114371abfd1d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:07.635327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eabdd-d865-49c6-ac93-114371abfd1d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:07.640391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:07.641054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.641336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.641602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.642320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:07.642624 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:07.644304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:07.659596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 909/1813] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:07.664321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2e9dc-4da8-42b5-bc94-e378a89545a3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:07.673673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2e9dc-4da8-42b5-bc94-e378a89545a3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:07.678442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:07.679075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.679386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.680008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.680802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:07.682744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:07.715041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 905/1814] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:07 2021] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:07.715809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:07.726136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea51ea-993d-419b-be92-6ab3a978a040 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:07.780963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:07.781606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.781882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.782152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.782831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:07.784775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:07.806631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 910/1815] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:07 2021] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:07.812743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:07.840685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9e58-819a-46bd-aa9a-eb8d8f8cfa12 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:07.845388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:07.846063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.846342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.846619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.847402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:07.849073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:07.862420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 906/1816] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:07.866677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:07.877927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fc91d-bb43-41c5-aac1-c8a2c8327c76 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:07.883580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3560-ae55-400f-b8e2-3a12b503d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:07.884260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3560-ae55-400f-b8e2-3a12b503d7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.884569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3560-ae55-400f-b8e2-3a12b503d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.884844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3560-ae55-400f-b8e2-3a12b503d7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.885621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3560-ae55-400f-b8e2-3a12b503d7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:07.887322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3560-ae55-400f-b8e2-3a12b503d7a1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:07.902606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 911/1817] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:07.908442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:07.922115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264c463-4fc0-431c-b18b-a7ab2334460d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:07.927869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:07.929007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.929292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.929886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] PATH_INFO: `/v3/projects/f53b4cca19a341be882f723a74640141/users/1a7cadc85711467083544ef85fef9f32/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:07.946469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53b4cca19a341be882f723a74640141, user_id=1a7cadc85711467083544ef85fef9f32, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:07.949856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:07.968181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 907/1818] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:07 2021] PUT /identity/v3/projects/f53b4cca19a341be882f723a74640141/users/1a7cadc85711467083544ef85fef9f32/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:07.977995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a471b-e3aa-4ae4-925a-e8d0ce468b6b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:07.978293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a471b-e3aa-4ae4-925a-e8d0ce468b6b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:07.978615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a471b-e3aa-4ae4-925a-e8d0ce468b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.012573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d79a471b-e3aa-4ae4-925a-e8d0ce468b6b None None] MFA Rules not processed for user `1a7cadc85711467083544ef85fef9f32`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:08.013774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d79a471b-e3aa-4ae4-925a-e8d0ce468b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:08.090678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 912/1819] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:07 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:08.095670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.163695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9e3c-22d6-4240-8d92-eedec6f341e2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.175605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.176314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.176599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.176876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.177958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.183007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.216724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 908/1820] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:08 2021] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:08.221116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a471b-e3aa-4ae4-925a-e8d0ce468b6b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.235382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a471b-e3aa-4ae4-925a-e8d0ce468b6b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.294662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.295447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.295773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.296052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.296910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.298689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.335539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 913/1821] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:08 2021] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:08.335645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.345419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc193df-d8d9-4bff-87ab-79cc3d1a7437 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.350626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.351438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.351780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.352133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.352950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.355116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.367408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 909/1822] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:08 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:08.372824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.382224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d352a-c188-475f-a874-6edda23b78f1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.387189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.388193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.388470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.388740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] PATH_INFO: `/v3/projects/2daba2481c734879af6f894590f24e73/users/00859c62c3844dfeb5990ab41e391008/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.405657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2daba2481c734879af6f894590f24e73, user_id=00859c62c3844dfeb5990ab41e391008, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.408315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.422154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 914/1823] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:08 2021] PUT /identity/v3/projects/2daba2481c734879af6f894590f24e73/users/00859c62c3844dfeb5990ab41e391008/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:08.426246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.437586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac11a7-8b1f-40be-ac04-beddbeab5854 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.493842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca6b5f-8a75-40de-968b-0c493aee7a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.494509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6b5f-8a75-40de-968b-0c493aee7a6d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.494793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6b5f-8a75-40de-968b-0c493aee7a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.495069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6b5f-8a75-40de-968b-0c493aee7a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.495838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca6b5f-8a75-40de-968b-0c493aee7a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.497441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca6b5f-8a75-40de-968b-0c493aee7a6d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.508241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 910/1824] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:08 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:08.513216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.527125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711118f-9b88-4a63-9614-b9b1af8afa4b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.532935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.534115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.534405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.534680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] PATH_INFO: `/v3/projects/2daba2481c734879af6f894590f24e73/users/00859c62c3844dfeb5990ab41e391008/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.536811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2daba2481c734879af6f894590f24e73, user_id=00859c62c3844dfeb5990ab41e391008, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.539583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.551081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 915/1825] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:08 2021] PUT /identity/v3/projects/2daba2481c734879af6f894590f24e73/users/00859c62c3844dfeb5990ab41e391008/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:08.562840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.563072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.563378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.595968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] MFA Rules not processed for user `00859c62c3844dfeb5990ab41e391008`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:08.597211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:08.676162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 911/1826] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:08 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:08.689557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.691619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:08.751754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a711a35-3b73-40de-b95e-831f54ba4331 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.756310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.757268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.757581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.757855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.767727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.769176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.778913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 916/1827] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:08 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:08.821110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:08.822600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:08.835206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a2c31-e9db-4729-90be-ed3adcc9a483 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:08.839226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb666462-ea2e-4bbd-b7ed-aa59218b0566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:08.840143 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb666462-ea2e-4bbd-b7ed-aa59218b0566 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:08.840404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb666462-ea2e-4bbd-b7ed-aa59218b0566 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:08.840798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb666462-ea2e-4bbd-b7ed-aa59218b0566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:08.909877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb666462-ea2e-4bbd-b7ed-aa59218b0566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:08.911366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb666462-ea2e-4bbd-b7ed-aa59218b0566 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:08.920724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 912/1828] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:08 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:09.054197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:09.120263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443d54-b217-43f5-a46e-e38c045ef557 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:09.125219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:09.126101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:09.126378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:09.126649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] PATH_INFO: `/v3/users/1a7cadc85711467083544ef85fef9f32` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:09.127889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7cadc85711467083544ef85fef9f32)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:09.129839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:09.180151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7cadc85711467083544ef85fef9f32'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.187148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7cadc85711467083544ef85fef9f32'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.187912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7cadc85711467083544ef85fef9f32'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.200694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7cadc85711467083544ef85fef9f32'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.201721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7cadc85711467083544ef85fef9f32'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.218331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 917/1829] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:09 2021] DELETE /identity/v3/users/1a7cadc85711467083544ef85fef9f32 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:09.234021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:09.234314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:09.234596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:09.254350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:09.256143 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:09.322037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 913/1830] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:09.332934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:09.335491 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:09.402033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e570-867a-42d7-a3a9-d43fc9819a94 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:09.406812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:09.406924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:09.407150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:09.407507 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:09.419737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:09.421126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:09.432446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 918/1831] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:09.724754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:09.726623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:09.740104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf714af-4752-49d1-80d0-dee84dee3ae2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:09.747907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:09.748777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:09.749072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:09.749341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] PATH_INFO: `/v3/projects/f53b4cca19a341be882f723a74640141` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:09.750605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53b4cca19a341be882f723a74640141)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:09.752688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:09.800903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53b4cca19a341be882f723a74640141', 'request_id': 'req-89933d4a-46d4-44b8-874e-191117b414ca'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.807819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53b4cca19a341be882f723a74640141', 'request_id': 'req-89933d4a-46d4-44b8-874e-191117b414ca'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.815128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53b4cca19a341be882f723a74640141', 'request_id': 'req-89933d4a-46d4-44b8-874e-191117b414ca'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.825825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] The token cache is being invalidate because project f53b4cca19a341be882f723a74640141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:09.826431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.826758 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.828359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 914/1832] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:09 2021] DELETE /identity/v3/projects/f53b4cca19a341be882f723a74640141 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:09.832425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:09.842595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f525f1-db42-4385-a326-dffd45b117ea service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:09.918484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:09.919376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:09.919679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:09.919954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] PATH_INFO: `/v3/users/00859c62c3844dfeb5990ab41e391008` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:09.921144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00859c62c3844dfeb5990ab41e391008)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:09.923077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:09.983329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00859c62c3844dfeb5990ab41e391008'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.990748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00859c62c3844dfeb5990ab41e391008'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:09.991639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00859c62c3844dfeb5990ab41e391008'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.005303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00859c62c3844dfeb5990ab41e391008'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.006066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d996cec0-54b9-4cca-bfbc-4e017a825cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00859c62c3844dfeb5990ab41e391008'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.024060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 919/1833] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:09 2021] DELETE /identity/v3/users/00859c62c3844dfeb5990ab41e391008 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:10.435679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:10.442461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:10.470976 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933d4a-46d4-44b8-874e-191117b414ca admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:10.572580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:10.573476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:10.573762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:10.575737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] PATH_INFO: `/v3/projects/2daba2481c734879af6f894590f24e73` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:10.577504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2daba2481c734879af6f894590f24e73)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:10.580631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:10.671657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2daba2481c734879af6f894590f24e73', 'request_id': 'req-92c53345-09f1-4581-afee-ddec0355b084'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.679326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2daba2481c734879af6f894590f24e73', 'request_id': 'req-92c53345-09f1-4581-afee-ddec0355b084'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.701527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2daba2481c734879af6f894590f24e73', 'request_id': 'req-92c53345-09f1-4581-afee-ddec0355b084'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.726896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] The token cache is being invalidate because project 2daba2481c734879af6f894590f24e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:10.727737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.728528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92c53345-09f1-4581-afee-ddec0355b084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:10.730288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 915/1834] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:10 2021] DELETE /identity/v3/projects/2daba2481c734879af6f894590f24e73 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:10.738730 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f30b6-6a22-43b0-921e-593f1245302b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:10.738954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f30b6-6a22-43b0-921e-593f1245302b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:10.739232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f30b6-6a22-43b0-921e-593f1245302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:10.770338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c09f30b6-6a22-43b0-921e-593f1245302b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:10.772244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c09f30b6-6a22-43b0-921e-593f1245302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:10.853356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 920/1835] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:10.861850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71cb1a-4888-419e-946f-b2c8b35e2a38 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:10.862391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71cb1a-4888-419e-946f-b2c8b35e2a38 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:10.862391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71cb1a-4888-419e-946f-b2c8b35e2a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:10.884369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-4f71cb1a-4888-419e-946f-b2c8b35e2a38 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:10.885595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4f71cb1a-4888-419e-946f-b2c8b35e2a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:10.896571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 916/1836] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:10.901032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f30b6-6a22-43b0-921e-593f1245302b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:10.914130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f30b6-6a22-43b0-921e-593f1245302b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:10.920888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:10.921621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:10.921964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:10.922303 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:10.923094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:10.923506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:10.925176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:10.939530 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 921/1837] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:10.942857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71cb1a-4888-419e-946f-b2c8b35e2a38 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:10.959390 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71cb1a-4888-419e-946f-b2c8b35e2a38 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:10.961818 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:10.962512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:10.962795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:10.963067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:10.963828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:10.965750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:10.992840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 917/1838] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:10 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:10.997481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.009116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0d6b-f735-46e5-ac2a-5123d0969190 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.073223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.073914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.074203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.074474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.075180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.077161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.097801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 922/1839] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:10 2021] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:11.102278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.114137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065951-86dc-4e96-9514-702628379ac8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.119013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.119732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.120007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.120277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.121075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.122773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.134009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 918/1840] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:11.137977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.148201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27815d8d-1184-4f2b-808b-f90b3ca862aa admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.152931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890eba83-4348-4661-82e1-44802a8c2c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.153594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eba83-4348-4661-82e1-44802a8c2c33 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.153875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eba83-4348-4661-82e1-44802a8c2c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.154193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890eba83-4348-4661-82e1-44802a8c2c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.154932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890eba83-4348-4661-82e1-44802a8c2c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.156535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890eba83-4348-4661-82e1-44802a8c2c33 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.167837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 923/1841] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:11.172094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.182979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164db740-9255-4c4c-9726-4717532836c9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.187809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.188898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.189175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.189553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] PATH_INFO: `/v3/projects/7171e2675f4d474e8a181829098af4b0/users/7bef6f61c2434b298c0a531dbafe06ca/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.203911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7171e2675f4d474e8a181829098af4b0, user_id=7bef6f61c2434b298c0a531dbafe06ca, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.206564 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.220383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 919/1842] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:11 2021] PUT /identity/v3/projects/7171e2675f4d474e8a181829098af4b0/users/7bef6f61c2434b298c0a531dbafe06ca/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:11.230776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41563a5-16f5-4853-8d9d-b30c35e5fbd8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.231072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41563a5-16f5-4853-8d9d-b30c35e5fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.231446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41563a5-16f5-4853-8d9d-b30c35e5fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.259590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b41563a5-16f5-4853-8d9d-b30c35e5fbd8 None None] MFA Rules not processed for user `7bef6f61c2434b298c0a531dbafe06ca`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:11.260737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b41563a5-16f5-4853-8d9d-b30c35e5fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:11.325638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 924/1843] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:11 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:11.330192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.396183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa7441-505a-46cf-821e-c83073c68fab admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.402495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.403315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.403743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.404135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.405021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.413552 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.443921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 920/1844] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:11 2021] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:11.448110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41563a5-16f5-4853-8d9d-b30c35e5fbd8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.459313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41563a5-16f5-4853-8d9d-b30c35e5fbd8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.528204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.529645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.530566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.531052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.532269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.536066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.564032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 925/1845] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:11 2021] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:11.565483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.577092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7e71-199b-4c26-bb27-679da9ed6a1e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.586925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.587884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.588227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.588505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.595199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.597107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.609048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 921/1846] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:11 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:11.612988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.623375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718abbb-2220-4427-82f6-72cc65544cc9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.630589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247c9f3-155d-43dc-8afb-12e31261b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.631890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c9f3-155d-43dc-8afb-12e31261b156 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.632369 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c9f3-155d-43dc-8afb-12e31261b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.632779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247c9f3-155d-43dc-8afb-12e31261b156 admin admin] PATH_INFO: `/v3/projects/ed70c7574d4d4351903d8505b897a183/users/f31837badf204575a9defb3b20bd62c6/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.649478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247c9f3-155d-43dc-8afb-12e31261b156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed70c7574d4d4351903d8505b897a183, user_id=f31837badf204575a9defb3b20bd62c6, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.653354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247c9f3-155d-43dc-8afb-12e31261b156 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.668737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 926/1847] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:11 2021] PUT /identity/v3/projects/ed70c7574d4d4351903d8505b897a183/users/f31837badf204575a9defb3b20bd62c6/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:11.673136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.684638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91bb89-ad37-4672-b917-81c29acbd524 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.684961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91bb89-ad37-4672-b917-81c29acbd524 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.685238 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91bb89-ad37-4672-b917-81c29acbd524 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.685347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cb51c-52cc-4c2a-b03b-143a870126d4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.687752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 927/1848] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:30:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:30:11.696044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968587db-b4e4-48b5-812f-5ab92f6c2235 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.696562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968587db-b4e4-48b5-812f-5ab92f6c2235 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.696958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968587db-b4e4-48b5-812f-5ab92f6c2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.735714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-968587db-b4e4-48b5-812f-5ab92f6c2235 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:11.736956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-968587db-b4e4-48b5-812f-5ab92f6c2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:11.828965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.829655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.829934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.830223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.833930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.839993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.867521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 922/1849] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:11 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:11.868595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:11.884557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 928/1850] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:30:11 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:11.888904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc631f64-4682-4da3-996a-c2a5ea9aa93b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:11.896071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:11.897136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.897407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.897679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] PATH_INFO: `/v3/projects/ed70c7574d4d4351903d8505b897a183/users/f31837badf204575a9defb3b20bd62c6/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.900097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed70c7574d4d4351903d8505b897a183, user_id=f31837badf204575a9defb3b20bd62c6, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:11.903271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:11.927393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 923/1851] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:11 2021] PUT /identity/v3/projects/ed70c7574d4d4351903d8505b897a183/users/f31837badf204575a9defb3b20bd62c6/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:11.938170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:11.938488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:11.938766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:11.973421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] MFA Rules not processed for user `f31837badf204575a9defb3b20bd62c6`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:11.974708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:12.085534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 929/1852] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:11 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:12.098600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:12.106170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:12.139028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:12.140911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:12.206886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96fa91-93d3-449c-b6fd-734a7757c7e7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:12.212733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99169b15-6b5c-4d39-acd9-cf2c5ee05226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:12.213945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99169b15-6b5c-4d39-acd9-cf2c5ee05226 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:12.214174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99169b15-6b5c-4d39-acd9-cf2c5ee05226 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:12.214446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99169b15-6b5c-4d39-acd9-cf2c5ee05226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:12.259279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4193f5-8500-4bd0-8dd3-4efacec02230 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:12.266284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:12.267027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:12.267513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:12.267717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:12.278778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:12.280691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:12.293862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 930/1853] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:12.312278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99169b15-6b5c-4d39-acd9-cf2c5ee05226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:12.314546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99169b15-6b5c-4d39-acd9-cf2c5ee05226 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:12.329156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 924/1854] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:12 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:12.659060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:12.661214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:12.777725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df36868-5911-47e6-a619-2ccae787fe26 service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:12.788987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:12.790048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:12.790392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:12.790803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] PATH_INFO: `/v3/users/904403649ee74ca1aaff7dc1dcb48c34` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:12.793357 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=904403649ee74ca1aaff7dc1dcb48c34)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:12.794594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:12.856561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904403649ee74ca1aaff7dc1dcb48c34'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:12.863654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904403649ee74ca1aaff7dc1dcb48c34'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:12.864359 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904403649ee74ca1aaff7dc1dcb48c34'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:12.878450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904403649ee74ca1aaff7dc1dcb48c34'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:12.878772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904403649ee74ca1aaff7dc1dcb48c34'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:12.897338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 931/1855] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:12 2021] DELETE /identity/v3/users/904403649ee74ca1aaff7dc1dcb48c34 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:12.902745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:12.903725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:12.904218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:12.926843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:12.928493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:13.040843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 925/1856] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:13.041970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:13.043564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:13.118854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d3cee-32d0-4db4-ab92-ce96de168d89 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:13.123566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32060e38-cbe8-4242-a38e-acc3577bba48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:13.124223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060e38-cbe8-4242-a38e-acc3577bba48 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:13.124563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060e38-cbe8-4242-a38e-acc3577bba48 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:13.124831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32060e38-cbe8-4242-a38e-acc3577bba48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:13.155844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32060e38-cbe8-4242-a38e-acc3577bba48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:13.157586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32060e38-cbe8-4242-a38e-acc3577bba48 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:13.162310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:13.165828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:13.178569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 932/1857] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:13.184596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408def7-c3a9-4a0b-acf8-f859d252b15f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:13.194533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:13.196583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:13.197006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:13.197450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] PATH_INFO: `/v3/users/ffdfb416719a488eae23235289e9855e` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:13.198818 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffdfb416719a488eae23235289e9855e)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:13.200822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:13.312182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffdfb416719a488eae23235289e9855e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.346408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffdfb416719a488eae23235289e9855e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.359865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffdfb416719a488eae23235289e9855e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.373892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffdfb416719a488eae23235289e9855e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.386691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffdfb416719a488eae23235289e9855e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.394832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 926/1858] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:13 2021] DELETE /identity/v3/users/ffdfb416719a488eae23235289e9855e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:13.400778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:13.400902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:13.401162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:13.422612 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:13.424049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:13.516913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 933/1859] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:13.526525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:13.535568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:13.624084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:13.625538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:13.636921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc0bb5-d8f1-43e3-a99a-7e337d53fca8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:13.644217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720eaf6-a03a-4f54-8ae9-53121ecfe5c6 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:13.644754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:13.645964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:13.646393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:13.646913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:13.649480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:13.650455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:13.650735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:13.651001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] PATH_INFO: `/v3/projects/c5e857d826c54cc0b3edcade22b2d293` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:13.652338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e857d826c54cc0b3edcade22b2d293)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:13.654466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:13.672423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:13.674310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:13.686267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 927/1860] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:13.709654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e857d826c54cc0b3edcade22b2d293', 'request_id': 'req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.717576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e857d826c54cc0b3edcade22b2d293', 'request_id': 'req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.724085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e857d826c54cc0b3edcade22b2d293', 'request_id': 'req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.740194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] The token cache is being invalidate because project c5e857d826c54cc0b3edcade22b2d293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:13.741042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.742351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:13.745543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 934/1861] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:13 2021] DELETE /identity/v3/projects/c5e857d826c54cc0b3edcade22b2d293 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:13.749689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:13.773916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d920e4-afbc-44af-966f-e71ab739eed2 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:13.891434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:13.892537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:13.893563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:13.893951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] PATH_INFO: `/v3/users/a7b4c881f562405b85cb0965c55a8ffa` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:13.910978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b4c881f562405b85cb0965c55a8ffa)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:13.917485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:13.925276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:13.927014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:13.942959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069de6e-8a9a-43e6-a203-9ed8b37e9e87 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:13.950976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:13.952473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:13.953078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:13.953539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] PATH_INFO: `/v3/users/37911cd6ec7540b990400630cf4a9a23` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:13.955395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37911cd6ec7540b990400630cf4a9a23)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:13.958632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:13.988948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b4c881f562405b85cb0965c55a8ffa'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.017515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b4c881f562405b85cb0965c55a8ffa'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.051656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37911cd6ec7540b990400630cf4a9a23'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.068338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b4c881f562405b85cb0965c55a8ffa'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.068492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37911cd6ec7540b990400630cf4a9a23'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.070479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37911cd6ec7540b990400630cf4a9a23'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.079033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b4c881f562405b85cb0965c55a8ffa'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.093667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b4c881f562405b85cb0965c55a8ffa'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.096094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37911cd6ec7540b990400630cf4a9a23'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.097333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3a9ae6c0-671a-42a3-bfab-5c863fe008a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37911cd6ec7540b990400630cf4a9a23'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.105716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 928/1862] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:13 2021] DELETE /identity/v3/users/a7b4c881f562405b85cb0965c55a8ffa => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:14.139101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 935/1863] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:13 2021] DELETE /identity/v3/users/37911cd6ec7540b990400630cf4a9a23 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:14.139297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:14.139297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:14.142610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:14.142912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:14.144456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:14.214377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:14.218499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:14.282274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352d25e-823f-48b3-92b9-d78fda04e229 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:14.345639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 936/1864] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:14.360274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:14.364842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:14.450438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:14.451724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:14.452169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:14.452593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] PATH_INFO: `/v3/projects/9964d17283ab4b8d8f347eaae1e0d7e9` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:14.455619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9964d17283ab4b8d8f347eaae1e0d7e9)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:14.457519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:14.578784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9964d17283ab4b8d8f347eaae1e0d7e9', 'request_id': 'req-383beeae-330b-45c2-b463-035ccc0c8df1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.583052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12971ba5-81a2-4b63-900a-a676790964a9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:14.590268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9964d17283ab4b8d8f347eaae1e0d7e9', 'request_id': 'req-383beeae-330b-45c2-b463-035ccc0c8df1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.602649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9964d17283ab4b8d8f347eaae1e0d7e9', 'request_id': 'req-383beeae-330b-45c2-b463-035ccc0c8df1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.646027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] The token cache is being invalidate because project 9964d17283ab4b8d8f347eaae1e0d7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:14.647530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.649840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-383beeae-330b-45c2-b463-035ccc0c8df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:14.653229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 929/1865] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:14 2021] DELETE /identity/v3/projects/9964d17283ab4b8d8f347eaae1e0d7e9 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:14.660610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:14.660945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:14.661292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:14.707293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:14.711677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:14.738066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1cfcd-520d-435e-a709-915d2e9adfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:14.738864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1cfcd-520d-435e-a709-915d2e9adfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:14.740685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1cfcd-520d-435e-a709-915d2e9adfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:14.741132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1cfcd-520d-435e-a709-915d2e9adfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:14.746297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-36e1cfcd-520d-435e-a709-915d2e9adfe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:14.873343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 930/1866] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:14.882345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:14.885716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:14.914238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff306d-e131-40a2-888a-350880b9b346 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:14.918475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1cfcd-520d-435e-a709-915d2e9adfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:14.924500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1cfcd-520d-435e-a709-915d2e9adfe6 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:14.934172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:14.935008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:14.935436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:14.935828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] PATH_INFO: `/v3/projects/eb2970fe74754ac2a4db9e96ae4384a2` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:14.939118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2970fe74754ac2a4db9e96ae4384a2)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:14.941195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:14.948788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 937/1867] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:14.951016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:14.953819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:14.955711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:14.992172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:14.994260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.011397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2970fe74754ac2a4db9e96ae4384a2', 'request_id': 'req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.019151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2970fe74754ac2a4db9e96ae4384a2', 'request_id': 'req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.029916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2970fe74754ac2a4db9e96ae4384a2', 'request_id': 'req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.061424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] The token cache is being invalidate because project eb2970fe74754ac2a4db9e96ae4384a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:15.061721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.062733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d97cdd30-2c76-4afc-b5f9-772f4ff18d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.064510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 931/1868] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:14 2021] DELETE /identity/v3/projects/eb2970fe74754ac2a4db9e96ae4384a2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:15.070651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28852-3526-425b-b768-35e2df23947c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.071004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28852-3526-425b-b768-35e2df23947c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.071535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28852-3526-425b-b768-35e2df23947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.100399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3ba28852-3526-425b-b768-35e2df23947c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:15.101816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3ba28852-3526-425b-b768-35e2df23947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.120613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 938/1869] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:15.122078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.124889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.138044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3373af-5d28-43f4-802c-aa975dd0b88b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.146835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.148615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.149601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.150185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] PATH_INFO: `/v3/users/7bef6f61c2434b298c0a531dbafe06ca` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.152974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bef6f61c2434b298c0a531dbafe06ca)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.155670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.178705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 932/1870] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:15.180387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28852-3526-425b-b768-35e2df23947c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.192186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28852-3526-425b-b768-35e2df23947c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.198015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00621286-2651-47e4-920b-4698111df94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.198823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621286-2651-47e4-920b-4698111df94c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.199117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621286-2651-47e4-920b-4698111df94c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.199547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621286-2651-47e4-920b-4698111df94c admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.200389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00621286-2651-47e4-920b-4698111df94c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:15.200768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00621286-2651-47e4-920b-4698111df94c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.202584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00621286-2651-47e4-920b-4698111df94c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.215669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 933/1871] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:15.217229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568aaa-0411-4324-9a6e-110d0c662a2c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.217586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568aaa-0411-4324-9a6e-110d0c662a2c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.218059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568aaa-0411-4324-9a6e-110d0c662a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.224292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bef6f61c2434b298c0a531dbafe06ca'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.231935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bef6f61c2434b298c0a531dbafe06ca'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.232736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bef6f61c2434b298c0a531dbafe06ca'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.237029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b1568aaa-0411-4324-9a6e-110d0c662a2c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:15.238242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b1568aaa-0411-4324-9a6e-110d0c662a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.246761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bef6f61c2434b298c0a531dbafe06ca'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.247594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bef6f61c2434b298c0a531dbafe06ca'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.251235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 934/1872] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:15.251235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568aaa-0411-4324-9a6e-110d0c662a2c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.261854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568aaa-0411-4324-9a6e-110d0c662a2c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.265661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 939/1873] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:15 2021] DELETE /identity/v3/users/7bef6f61c2434b298c0a531dbafe06ca => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:15.267295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d78b85-71e4-443f-a06a-53d59499518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.268043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d78b85-71e4-443f-a06a-53d59499518c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.268323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d78b85-71e4-443f-a06a-53d59499518c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.268612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d78b85-71e4-443f-a06a-53d59499518c admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.269279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d78b85-71e4-443f-a06a-53d59499518c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.269596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.271187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.271322 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d78b85-71e4-443f-a06a-53d59499518c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.303627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 935/1874] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:15 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:15.303627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.303627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.303627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.320959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:15.322189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.344364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2324a-bb63-4a21-8783-401f044f8af3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.397112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 936/1875] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:15.398331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.400296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.410423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.410700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.410986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.411410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.412233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:15.412567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.414726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.415566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3411d9-7c34-4073-baef-e00c5312ffb7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.420222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.420972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.421347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.421682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.422463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.424472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.427722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 940/1876] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:15.429008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.433145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.446203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e96e2-5668-407d-b193-6955d928ac09 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.449543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 937/1877] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:15 2021] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:15.449543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.449543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.451109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.452004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.452317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.452594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] PATH_INFO: `/v3/projects/87a447abed3746a988777d61ceb08cf5` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.453770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a447abed3746a988777d61ceb08cf5)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.455711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.511626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a447abed3746a988777d61ceb08cf5', 'request_id': 'req-457d036b-17d3-47c2-ab8f-0e712f05914e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.512510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5a69-36d6-414d-a7d8-a7cf8e4882c5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.518470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a447abed3746a988777d61ceb08cf5', 'request_id': 'req-457d036b-17d3-47c2-ab8f-0e712f05914e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.527785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a447abed3746a988777d61ceb08cf5', 'request_id': 'req-457d036b-17d3-47c2-ab8f-0e712f05914e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.545774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] The token cache is being invalidate because project 87a447abed3746a988777d61ceb08cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:15.546084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.548143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.550864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 941/1878] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:15 2021] DELETE /identity/v3/projects/87a447abed3746a988777d61ceb08cf5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:15.554407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.556333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.578240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.579335 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.579741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.580113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.583316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.641634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d036b-17d3-47c2-ab8f-0e712f05914e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.647121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.647828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.648110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.648423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.649128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.651295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.658568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.660771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.672563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 938/1879] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:15.674535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.676633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.688088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 942/1880] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:15 2021] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:15.688088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.688088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.693831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe88b3-75b2-425b-8a1b-e453d7a165fc service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.754850 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3def8-96a0-4df0-bc9c-1b80c1aecce8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.757832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.759242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.759867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.760258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.760586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.761136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.761440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.761783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] PATH_INFO: `/v3/users/e9c0f9f48e3c49cb9aaa2e87e058cd7e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.762173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.763029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c0f9f48e3c49cb9aaa2e87e058cd7e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.764919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.765178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.781679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 939/1881] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:15 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:15.783085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.797423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8ee14-82cc-4146-81d3-fc332f17a6cb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.805498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.806263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.808295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.808684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.809474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.811531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.828211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c0f9f48e3c49cb9aaa2e87e058cd7e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.837208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c0f9f48e3c49cb9aaa2e87e058cd7e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.838426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c0f9f48e3c49cb9aaa2e87e058cd7e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.843031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 940/1882] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:15 2021] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:15.843031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.852783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02af6e-a6f9-4b72-b156-0bb6ac8494a6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.856269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c0f9f48e3c49cb9aaa2e87e058cd7e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.857107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c0f9f48e3c49cb9aaa2e87e058cd7e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:15.858637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:15.859327 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:15.859686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:15.859903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:15.860641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:15.862344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:15.876208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 943/1883] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:15 2021] DELETE /identity/v3/users/e9c0f9f48e3c49cb9aaa2e87e058cd7e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:15.877190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.878634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.882275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 941/1884] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:15 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:15.885502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:15.889268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:15.907744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19051237-d33e-4ee8-9add-1815dc0d8dc6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:15.996816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194f1a7-8d12-48c1-8f77-d1b6aa1b7873 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.007950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.008868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.009152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.009426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.010209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.011875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.021375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480812dc-e0da-4427-9556-d66a996553a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.023320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480812dc-e0da-4427-9556-d66a996553a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.025402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480812dc-e0da-4427-9556-d66a996553a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.025795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480812dc-e0da-4427-9556-d66a996553a5 admin admin] PATH_INFO: `/v3/projects/c04816005b9a40d7a811cf33a8c52e20/users/59c2bfeec32a4476ace1e574625e4f87/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.029173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 944/1885] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:15 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:16.030113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:16.049887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480812dc-e0da-4427-9556-d66a996553a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04816005b9a40d7a811cf33a8c52e20, user_id=59c2bfeec32a4476ace1e574625e4f87, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.054972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480812dc-e0da-4427-9556-d66a996553a5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.056441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838c26a-f151-4314-ad1b-e3ef6aa49bbf admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.070109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.070556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.070956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.071232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.072169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.082037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 942/1886] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:15 2021] PUT /identity/v3/projects/c04816005b9a40d7a811cf33a8c52e20/users/59c2bfeec32a4476ace1e574625e4f87/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:16.082248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.084381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.084810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.085376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.091258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 945/1887] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:16 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:16.095472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:16.110503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77620003-5956-4fbf-9331-e6353b76f0d2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.139810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] MFA Rules not processed for user `59c2bfeec32a4476ace1e574625e4f87`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:16.141651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.197085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.198228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.198611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.198984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] PATH_INFO: `/v3/projects/e15f14b108b54811bd061d2f3cc4150d/users/f156aa45a8d64fedaaa9df544ba4d92e/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.220907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15f14b108b54811bd061d2f3cc4150d, user_id=f156aa45a8d64fedaaa9df544ba4d92e, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.225459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 943/1888] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:16 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:16.225459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:16.227739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.228253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.250667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 946/1889] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:16 2021] PUT /identity/v3/projects/e15f14b108b54811bd061d2f3cc4150d/users/f156aa45a8d64fedaaa9df544ba4d92e/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:16.254683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:16.254683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.274746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe1291-01b5-4a5e-b86e-1490dc67a394 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.325970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba7ab8-1ae4-45c0-801a-36b88f005715 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.333671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5863177-3291-4e67-b286-d3038ffe5479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.334557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5863177-3291-4e67-b286-d3038ffe5479 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.335199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5863177-3291-4e67-b286-d3038ffe5479 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.335596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5863177-3291-4e67-b286-d3038ffe5479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.362218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.363227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.363709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.364054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] PATH_INFO: `/v3/projects/7171e2675f4d474e8a181829098af4b0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.365496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7171e2675f4d474e8a181829098af4b0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.372322 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.418296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5863177-3291-4e67-b286-d3038ffe5479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.419823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5863177-3291-4e67-b286-d3038ffe5479 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.432896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 947/1890] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:16 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:16.457912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.460786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.461220 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.478713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7171e2675f4d474e8a181829098af4b0', 'request_id': 'req-b988b8b7-59bb-439e-b3b0-0123626b0f3e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.487539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:16.489368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.504142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7171e2675f4d474e8a181829098af4b0', 'request_id': 'req-b988b8b7-59bb-439e-b3b0-0123626b0f3e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.523994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7171e2675f4d474e8a181829098af4b0', 'request_id': 'req-b988b8b7-59bb-439e-b3b0-0123626b0f3e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.536353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] The token cache is being invalidate because project 7171e2675f4d474e8a181829098af4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:16.537047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.537979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.540696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 944/1891] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:16 2021] DELETE /identity/v3/projects/7171e2675f4d474e8a181829098af4b0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:16.544300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:16.545796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.581835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 948/1892] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:16.585357 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:16.586443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.603191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58450ad4-0a16-4c01-ac07-840028666ecf None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.607726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.609201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.609201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.609201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] PATH_INFO: `/v3/users/f31837badf204575a9defb3b20bd62c6` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.610777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31837badf204575a9defb3b20bd62c6)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.613428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.654024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988b8b7-59bb-439e-b3b0-0123626b0f3e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.671279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.672218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.672515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.672798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] PATH_INFO: `/v3/projects/e549f2f0c0074d5f9464d423b33995f1` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.676290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e549f2f0c0074d5f9464d423b33995f1)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:16.678277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:16.701234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31837badf204575a9defb3b20bd62c6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.709745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31837badf204575a9defb3b20bd62c6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.710942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31837badf204575a9defb3b20bd62c6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.728306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31837badf204575a9defb3b20bd62c6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.729387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31837badf204575a9defb3b20bd62c6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.750056 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e549f2f0c0074d5f9464d423b33995f1', 'request_id': 'req-6a593841-9111-4e16-bd29-1f9d570af9b8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.750245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 949/1893] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:16 2021] DELETE /identity/v3/users/f31837badf204575a9defb3b20bd62c6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:16.751323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:16.754683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.778305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e549f2f0c0074d5f9464d423b33995f1', 'request_id': 'req-6a593841-9111-4e16-bd29-1f9d570af9b8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.789657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e549f2f0c0074d5f9464d423b33995f1', 'request_id': 'req-6a593841-9111-4e16-bd29-1f9d570af9b8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.812398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] The token cache is being invalidate because project e549f2f0c0074d5f9464d423b33995f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:16.812771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.813602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a593841-9111-4e16-bd29-1f9d570af9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:16.820012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 945/1894] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:16 2021] DELETE /identity/v3/projects/e549f2f0c0074d5f9464d423b33995f1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:16.822284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262a42a-5fd9-474c-8e67-68ac10d7d0ba None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.822682 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262a42a-5fd9-474c-8e67-68ac10d7d0ba None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.823021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262a42a-5fd9-474c-8e67-68ac10d7d0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.849582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7262a42a-5fd9-474c-8e67-68ac10d7d0ba None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:16.852051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7262a42a-5fd9-474c-8e67-68ac10d7d0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.866846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a37f18-91ac-497d-85a4-d8fa9d684469 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:16.887673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:16.907697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:16.907697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:16.907697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:16.911435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:16.975127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 946/1895] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:17.014789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47220-7c96-4dd9-ae3a-b7100aac863b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.015087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47220-7c96-4dd9-ae3a-b7100aac863b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.015375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c47220-7c96-4dd9-ae3a-b7100aac863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.036623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f1c47220-7c96-4dd9-ae3a-b7100aac863b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:17.040480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f1c47220-7c96-4dd9-ae3a-b7100aac863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:17.055431 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.057322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.064434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 947/1896] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:17.065416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c47220-7c96-4dd9-ae3a-b7100aac863b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.073914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 950/1897] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:17.087950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c47220-7c96-4dd9-ae3a-b7100aac863b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:17.096068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:17.097120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.098276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.098694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.099838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:17.100993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.103518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.117635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 948/1898] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:17.123340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.140012 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6cffc-5457-4d88-be01-672ec2214668 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:17.145211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:17.145892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.146175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.146569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.148041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.150170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.198718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 951/1899] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:17 2021] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:17.199256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.210814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43b879-2428-43ec-9613-f89a5f985813 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:17.277078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.279956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:17.346054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:17.346937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.347457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.347836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.348640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.350903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.374380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566f062-142e-4994-bfa3-bf713c86cde4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:17.385309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 949/1900] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:17 2021] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:17.388426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.399790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:17.401222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.401729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.402076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] PATH_INFO: `/v3/projects/ed70c7574d4d4351903d8505b897a183` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.403740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed70c7574d4d4351903d8505b897a183)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.406215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151886a-fe1b-40fa-a9ef-dc85709b739c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:17.407525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.417104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:17.419951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.420361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.420744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.422393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.424386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.438048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 950/1901] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:17 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:17.441748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.477118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd13f-eba5-4a04-b3ae-ad5a3911b8a5 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:17.488743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:17.490102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.490798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.491244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.492213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.494148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.500794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed70c7574d4d4351903d8505b897a183', 'request_id': 'req-8279e649-8454-4411-85c0-662c8b5f1be7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:17.509834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed70c7574d4d4351903d8505b897a183', 'request_id': 'req-8279e649-8454-4411-85c0-662c8b5f1be7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:17.516859 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed70c7574d4d4351903d8505b897a183', 'request_id': 'req-8279e649-8454-4411-85c0-662c8b5f1be7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:17.525334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 951/1902] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:17 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:17.528542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.536894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] The token cache is being invalidate because project ed70c7574d4d4351903d8505b897a183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:17.537275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:17.538120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8279e649-8454-4411-85c0-662c8b5f1be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:17.546539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 952/1903] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:17 2021] DELETE /identity/v3/projects/ed70c7574d4d4351903d8505b897a183 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:17.551438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485d48-b73f-495c-a6c2-97d07c1fbeac None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.551849 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485d48-b73f-495c-a6c2-97d07c1fbeac None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.552198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31485d48-b73f-495c-a6c2-97d07c1fbeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.553071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f44168-5a62-4857-8903-57daf11a172d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:17.575813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-31485d48-b73f-495c-a6c2-97d07c1fbeac None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:17.577348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-31485d48-b73f-495c-a6c2-97d07c1fbeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:17.649439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd1b6e-a3ef-471f-89e3-f8544733c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:17.651816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1b6e-a3ef-471f-89e3-f8544733c547 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.652315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1b6e-a3ef-471f-89e3-f8544733c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.652422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd1b6e-a3ef-471f-89e3-f8544733c547 admin admin] PATH_INFO: `/v3/projects/eb1ff406ab9647138f90fd3d2af81691/users/8c6100f9b18444ca9ea6c8043516770d/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.678993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd1b6e-a3ef-471f-89e3-f8544733c547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1ff406ab9647138f90fd3d2af81691, user_id=8c6100f9b18444ca9ea6c8043516770d, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:17.683553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd1b6e-a3ef-471f-89e3-f8544733c547 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:17.715783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 952/1904] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:17 2021] PUT /identity/v3/projects/eb1ff406ab9647138f90fd3d2af81691/users/8c6100f9b18444ca9ea6c8043516770d/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:17.717793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 953/1905] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:17.723923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.724621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.725457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.730910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063cc71-a54b-4122-8650-1de9fe8ded8c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:17.731310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063cc71-a54b-4122-8650-1de9fe8ded8c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:17.731638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063cc71-a54b-4122-8650-1de9fe8ded8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:17.777361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5063cc71-a54b-4122-8650-1de9fe8ded8c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:17.779816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5063cc71-a54b-4122-8650-1de9fe8ded8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:17.779989 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] MFA Rules not processed for user `8c6100f9b18444ca9ea6c8043516770d`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:17.781219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:17.861465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 953/1906] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:17 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:17.867005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.870092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:17.952402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 954/1907] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:17.958576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063cc71-a54b-4122-8650-1de9fe8ded8c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:17.990107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063cc71-a54b-4122-8650-1de9fe8ded8c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.004393 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.005173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.005655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.005904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.008691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:18.009855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.011930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.021218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a31d2-a804-48c7-8357-828b48055ec3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.027458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.028639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.029026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.029429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.030688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.033516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.046732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 955/1908] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:18.054138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.077046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 954/1909] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:17 2021] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:18.084860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.088829 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8cb21-d76a-44f4-b8f6-72b42600ef2d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.211497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c100d7-8684-486c-a076-e4e486dd0ca1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.224982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.225671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.227002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.227287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.233467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.234152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.234448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.236743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.238210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.238552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.239458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.243674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.290506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 955/1910] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:18 2021] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:18.294050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.303080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 956/1911] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:18 2021] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:18.306032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.309895 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3862240-0095-48d2-b76b-ed86d41b6dae admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.422134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a0f8-5cc4-4fd2-9535-9355e02480ad admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.427878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.429347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.429943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.430377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.431095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.433056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.442837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.443786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.444243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.444594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.448057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.449861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.463660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 957/1912] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:18 2021] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:18.463769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 956/1913] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:18 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:18.468554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.469745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.484094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3c2d3-ea50-49b0-985f-a73fea6c402a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.485779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539b335-c2ce-4c47-ae97-e7c2ef158618 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.491148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.495213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.495213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.495213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.495608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.497317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.498577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f1da5-d6d7-4670-83ef-8a50f99dc9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.500618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1da5-d6d7-4670-83ef-8a50f99dc9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.501247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1da5-d6d7-4670-83ef-8a50f99dc9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.501424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1da5-d6d7-4670-83ef-8a50f99dc9f8 admin admin] PATH_INFO: `/v3/projects/2f3799d96c50480f86ddfd688f5495f0/users/9dfaa711631d4d1aac5d5a3ebc2b806e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.514420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 958/1914] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:18 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:18.515594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.538277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f1da5-d6d7-4670-83ef-8a50f99dc9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3799d96c50480f86ddfd688f5495f0, user_id=9dfaa711631d4d1aac5d5a3ebc2b806e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.542936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f1da5-d6d7-4670-83ef-8a50f99dc9f8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.546721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7366ce-f460-4871-9fea-e287ae92b2f3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.564127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.564909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.565226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.565780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.566606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.569382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.579760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 957/1915] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:18 2021] PUT /identity/v3/projects/2f3799d96c50480f86ddfd688f5495f0/users/9dfaa711631d4d1aac5d5a3ebc2b806e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:18.581300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e248a-4687-4e44-adb9-7eca445bdaf8 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.582909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e248a-4687-4e44-adb9-7eca445bdaf8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.583269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e248a-4687-4e44-adb9-7eca445bdaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.591758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 959/1916] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:18 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:18.593464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.620774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2578-bf77-4270-8e42-8759171efa1b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.622262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-820e248a-4687-4e44-adb9-7eca445bdaf8 None None] MFA Rules not processed for user `f156aa45a8d64fedaaa9df544ba4d92e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:18.623619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-820e248a-4687-4e44-adb9-7eca445bdaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:18.757499 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 958/1917] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:18.758528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.758666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e248a-4687-4e44-adb9-7eca445bdaf8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.759240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.759664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.759945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.761071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.762762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.781052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e248a-4687-4e44-adb9-7eca445bdaf8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.799075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.799283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 960/1918] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:18 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:18.799429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.799509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.799582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.799582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] PATH_INFO: `/v3/projects/b6fd4f3836f140c0a1e3173abaad0f95/users/5c60cdebf66741eab0c8cd28319f8088/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.801644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:18.834238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6fd4f3836f140c0a1e3173abaad0f95, user_id=5c60cdebf66741eab0c8cd28319f8088, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.838804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.841304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78ea90-892b-4398-9fac-cf85f82a1538 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:18.849406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f4470-9c83-43d7-9ffb-afc234a4ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:18.850723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4470-9c83-43d7-9ffb-afc234a4ee67 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.851008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4470-9c83-43d7-9ffb-afc234a4ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.851283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4470-9c83-43d7-9ffb-afc234a4ee67 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.852068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f4470-9c83-43d7-9ffb-afc234a4ee67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:18.854095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f4470-9c83-43d7-9ffb-afc234a4ee67 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:18.867866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 959/1919] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:18 2021] PUT /identity/v3/projects/b6fd4f3836f140c0a1e3173abaad0f95/users/5c60cdebf66741eab0c8cd28319f8088/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:18.870586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:18.905276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 961/1920] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:18 2021] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:18.907272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a4c4e-8af6-4874-9d68-7e0b8c1a33d8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:18.907594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a4c4e-8af6-4874-9d68-7e0b8c1a33d8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:18.908008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a4c4e-8af6-4874-9d68-7e0b8c1a33d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:18.952931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-336a4c4e-8af6-4874-9d68-7e0b8c1a33d8 None None] MFA Rules not processed for user `5c60cdebf66741eab0c8cd28319f8088`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:18.954157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-336a4c4e-8af6-4874-9d68-7e0b8c1a33d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:18.973899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8b46c-dacb-47c1-8588-675dc0702f41 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.069830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.071088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.071526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.071904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] PATH_INFO: `/v3/projects/2f3799d96c50480f86ddfd688f5495f0/users/9dfaa711631d4d1aac5d5a3ebc2b806e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.075153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3799d96c50480f86ddfd688f5495f0, user_id=9dfaa711631d4d1aac5d5a3ebc2b806e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.078858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:19.092889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 960/1921] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:18 2021] PUT /identity/v3/projects/2f3799d96c50480f86ddfd688f5495f0/users/9dfaa711631d4d1aac5d5a3ebc2b806e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:19.094040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:19.101111 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 962/1922] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:18 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:19.107575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.109075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.109873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.172230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] MFA Rules not processed for user `9dfaa711631d4d1aac5d5a3ebc2b806e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:19.173449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:19.212915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a36ce-8b8f-4a0f-a877-7d4a29249e2b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.220143 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.221124 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.222228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.222766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.223712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.226923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:19.264041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 963/1923] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:19 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:19.264995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:19.270585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:19.280842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 961/1924] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:19 2021] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:19.282263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:19.284932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:19.383413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeacf1f-388c-4d48-904e-2d91374cd688 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.389207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.395324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b8265-0ac8-4698-b256-2fc1e492270f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.396268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.396731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.396878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.397494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.397773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.398162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.398514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.409875 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.411483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:19.430084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 962/1925] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:19 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:19.431435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:19.443782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a16e1-f1f0-47c9-b3d6-659d7245ce4a service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.450740 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.451658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.452038 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.452412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.453273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.458956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:19.474843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 963/1926] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:19.476133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:19.479692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:19.495285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.496587 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f6d84-f6a1-48fa-a029-429af220d87c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.497746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:19.502856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.504126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.505252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.505850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] PATH_INFO: `/v3/users/59c2bfeec32a4476ace1e574625e4f87` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.507900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c2bfeec32a4476ace1e574625e4f87)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.510372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:19.521237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 964/1927] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:19 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:19.521884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:19.550772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54e57e-44d6-418a-9aa9-5563a14c26c1 service glance] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.564394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.564394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.565652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.569874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] PATH_INFO: `/v3/projects/c0841ae69d444961bd38ab563c31821c/users/ca33dbd3192242ca8cc2b9c61810e06b/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.623476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0841ae69d444961bd38ab563c31821c, user_id=ca33dbd3192242ca8cc2b9c61810e06b, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.632417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:19.647062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c2bfeec32a4476ace1e574625e4f87'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:19.668864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 965/1928] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:19 2021] PUT /identity/v3/projects/c0841ae69d444961bd38ab563c31821c/users/ca33dbd3192242ca8cc2b9c61810e06b/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:19.687278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:19.704182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c2bfeec32a4476ace1e574625e4f87'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:19.725383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c2bfeec32a4476ace1e574625e4f87'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:19.727766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c2bfeec32a4476ace1e574625e4f87'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:19.743557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7fb4ac11-8692-4148-9ab2-45740af7114d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c2bfeec32a4476ace1e574625e4f87'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:19.755149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 964/1929] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:19 2021] DELETE /identity/v3/users/59c2bfeec32a4476ace1e574625e4f87 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:19.760191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.760491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.760775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.804216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:19.807887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:19.859954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bcf55-55e5-454f-9484-c248eaaae3c2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:19.977483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 965/1930] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:19.997736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:19.997736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:19.997736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:19.997736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:19.998308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:19.999856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:20.005182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:20.007555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:20.020048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 966/1931] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:20.023719 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:20.028861 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:20.063474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e491d14-96b5-4a98-b141-9b10fa75e074 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:20.069865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:20.071144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:20.071144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:20.071374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] PATH_INFO: `/v3/projects/c0841ae69d444961bd38ab563c31821c/users/ca33dbd3192242ca8cc2b9c61810e06b/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:20.080926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0841ae69d444961bd38ab563c31821c, user_id=ca33dbd3192242ca8cc2b9c61810e06b, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:20.083666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:20.103881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 967/1932] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:20 2021] PUT /identity/v3/projects/c0841ae69d444961bd38ab563c31821c/users/ca33dbd3192242ca8cc2b9c61810e06b/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:20.181781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e785-2f2c-476b-a76f-4d975c2eda50 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:20.254068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b8f5e-c62d-483a-a774-51a357005028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:20.255697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8f5e-c62d-483a-a774-51a357005028 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:20.257181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8f5e-c62d-483a-a774-51a357005028 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:20.257573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8f5e-c62d-483a-a774-51a357005028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:20.447054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b8f5e-c62d-483a-a774-51a357005028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:20.448566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b8f5e-c62d-483a-a774-51a357005028 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:20.476007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 966/1933] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:21.846263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:21.848333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:21.870442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3d554-efe8-43a8-9239-412566ede5e9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:21.892007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:21.893126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:21.893568 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:21.894705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] PATH_INFO: `/v3/projects/c04816005b9a40d7a811cf33a8c52e20` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:21.896224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04816005b9a40d7a811cf33a8c52e20)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:21.898875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:22.005117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04816005b9a40d7a811cf33a8c52e20', 'request_id': 'req-9ca49ec5-c402-4642-8003-0af64e4df809'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.029718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04816005b9a40d7a811cf33a8c52e20', 'request_id': 'req-9ca49ec5-c402-4642-8003-0af64e4df809'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.046953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04816005b9a40d7a811cf33a8c52e20', 'request_id': 'req-9ca49ec5-c402-4642-8003-0af64e4df809'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.070834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] The token cache is being invalidate because project c04816005b9a40d7a811cf33a8c52e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:22.071286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.075844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.082392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 968/1934] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:21 2021] DELETE /identity/v3/projects/c04816005b9a40d7a811cf33a8c52e20 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:22.083422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150838-eb79-4631-9367-040c44803afc None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.084079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150838-eb79-4631-9367-040c44803afc None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.084394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150838-eb79-4631-9367-040c44803afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.104970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a6150838-eb79-4631-9367-040c44803afc None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:22.106721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a6150838-eb79-4631-9367-040c44803afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.186514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:22.188506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.265457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 967/1935] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:22.268271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0a6e-6312-4c01-972a-75feca52ddf9 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.273026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0a6e-6312-4c01-972a-75feca52ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.273359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0a6e-6312-4c01-972a-75feca52ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.306759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-50ce0a6e-6312-4c01-972a-75feca52ddf9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:22.310945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-50ce0a6e-6312-4c01-972a-75feca52ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.328485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 968/1936] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:22.330166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeaf99-e4f9-41a0-b5ab-d23cd9bb71e5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.330462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeaf99-e4f9-41a0-b5ab-d23cd9bb71e5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.330743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfeaf99-e4f9-41a0-b5ab-d23cd9bb71e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.340014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca49ec5-c402-4642-8003-0af64e4df809 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:22.348960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:22.350650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.351041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.351770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] PATH_INFO: `/v3/users/8c6100f9b18444ca9ea6c8043516770d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.353953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6100f9b18444ca9ea6c8043516770d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:22.356085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:22.364277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0dfeaf99-e4f9-41a0-b5ab-d23cd9bb71e5 None None] MFA Rules not processed for user `ca33dbd3192242ca8cc2b9c61810e06b`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:22.365538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0dfeaf99-e4f9-41a0-b5ab-d23cd9bb71e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.453217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6100f9b18444ca9ea6c8043516770d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.467753 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6100f9b18444ca9ea6c8043516770d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.470212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6100f9b18444ca9ea6c8043516770d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.525588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6100f9b18444ca9ea6c8043516770d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.527045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6100f9b18444ca9ea6c8043516770d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:22.548457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 969/1937] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:22 2021] DELETE /identity/v3/users/8c6100f9b18444ca9ea6c8043516770d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:22.549598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:22.551211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.557040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 969/1938] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:22 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:22.563464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a4f7-d36b-4810-9596-a4936c5c45ae None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.563826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a4f7-d36b-4810-9596-a4936c5c45ae None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.564110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a4f7-d36b-4810-9596-a4936c5c45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.629995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072edab-f064-4a79-b9d8-e0febc1ee194 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:22.635662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:22.636228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1d12a4f7-d36b-4810-9596-a4936c5c45ae None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:22.637100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.637389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.637503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1d12a4f7-d36b-4810-9596-a4936c5c45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.637725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.638473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:22.638782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:22.641068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:22.659382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 970/1939] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:22.659382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:22.660798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.673177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 970/1940] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:22.673177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a4f7-d36b-4810-9596-a4936c5c45ae None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:22.698671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a4f7-d36b-4810-9596-a4936c5c45ae None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:22.708489 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:22.709529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.709967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.710404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.711252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:22.713476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:22.727759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211a3d-10e0-4861-a30d-03473773d4e1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:22.731925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:22.732596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.732878 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.733154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.735029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.786446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 971/1941] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:22 2021] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:22.788258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:22.792376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:22.803807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:22.805724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:22.818627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 971/1942] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:22 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:22.819593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:22.833007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0065dd-5b77-49f2-8732-95b502cb0dd9 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:22.918219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:22.920658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.922815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.922815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.923684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:22.927840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:22.934927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d7c78-f6ea-4a55-b639-eaf5334fbb30 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:22.939606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:22.939916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:22.940299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:22.940672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:22.961382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:22.965545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 972/1943] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:22 2021] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:22.965706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:22.977736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 972/1944] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:22.983533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:22.997113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129f0a-8601-41f9-8673-1c9535056f95 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:23.002489 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:23.003177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:23.003495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:23.003772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:23.004568 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:23.006671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:23.031200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 973/1945] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:22 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:23.033194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:23.050985 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f5cd3-8422-487b-ba87-24a6ae4bbf21 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:23.063092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a1478-cb09-4507-a59c-bd8a94bf100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:23.066655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a1478-cb09-4507-a59c-bd8a94bf100f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:23.067035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a1478-cb09-4507-a59c-bd8a94bf100f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:23.067435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a1478-cb09-4507-a59c-bd8a94bf100f admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:23.068733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a1478-cb09-4507-a59c-bd8a94bf100f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:23.074079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a1478-cb09-4507-a59c-bd8a94bf100f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:23.092839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 973/1946] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:23 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:23.096670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:23.113266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebbb5-4d38-4276-b2e2-61ce3ef38545 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:23.120523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:23.121668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:23.122019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:23.122641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] PATH_INFO: `/v3/projects/2cd8469837974206a864b7a482bc6e21/users/c62d643d4c824ee8bfffba1a177f48ce/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:23.153906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd8469837974206a864b7a482bc6e21, user_id=c62d643d4c824ee8bfffba1a177f48ce, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:23.157535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:23.177145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 974/1947] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:23 2021] PUT /identity/v3/projects/2cd8469837974206a864b7a482bc6e21/users/c62d643d4c824ee8bfffba1a177f48ce/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:23.189612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:23.190118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:23.190459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:23.301642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] MFA Rules not processed for user `c62d643d4c824ee8bfffba1a177f48ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:23.302935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:23.431537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 974/1948] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:23 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:23.448867 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:23.451323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:23.514704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5847175-e074-4184-bb01-83bdfeff9224 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:23.518815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:23.519898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:23.520345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:23.520623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:23.531158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:23.533045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:23.550395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 975/1949] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:23 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:23.645992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:23.648284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:23.797947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453aca1-dac5-411f-8c12-c62153f5364c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:23.803571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:23.804981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:23.805328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:23.807122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] PATH_INFO: `/v3/projects/eb1ff406ab9647138f90fd3d2af81691` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:23.807122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1ff406ab9647138f90fd3d2af81691)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:23.813155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:23.897953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1ff406ab9647138f90fd3d2af81691', 'request_id': 'req-c523488c-75ef-4b6c-b9ca-ac051337ca75'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:23.911175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1ff406ab9647138f90fd3d2af81691', 'request_id': 'req-c523488c-75ef-4b6c-b9ca-ac051337ca75'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:23.920426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1ff406ab9647138f90fd3d2af81691', 'request_id': 'req-c523488c-75ef-4b6c-b9ca-ac051337ca75'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:23.935147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] The token cache is being invalidate because project eb1ff406ab9647138f90fd3d2af81691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:23.935581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:23.936410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:23.938877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 975/1950] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:23 2021] DELETE /identity/v3/projects/eb1ff406ab9647138f90fd3d2af81691 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:23.942885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:23.957239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3ef0-5f91-4d66-91fa-c6085ca4e197 service glance] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:24.015210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:24.016182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.016458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.016733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] PATH_INFO: `/v3/users/9dfaa711631d4d1aac5d5a3ebc2b806e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.022549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfaa711631d4d1aac5d5a3ebc2b806e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:24.022549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:24.090899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfaa711631d4d1aac5d5a3ebc2b806e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.099923 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfaa711631d4d1aac5d5a3ebc2b806e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.102003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfaa711631d4d1aac5d5a3ebc2b806e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.116076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfaa711631d4d1aac5d5a3ebc2b806e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.116858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfaa711631d4d1aac5d5a3ebc2b806e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.134591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 976/1951] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:23 2021] DELETE /identity/v3/users/9dfaa711631d4d1aac5d5a3ebc2b806e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:24.458349 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:24.460519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:24.467607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:24.469219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:24.528763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523488c-75ef-4b6c-b9ca-ac051337ca75 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:24.543590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef402b-8d76-4cda-bb21-698174865710 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:24.548375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:24.549232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.549509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.549777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] PATH_INFO: `/v3/projects/2f3799d96c50480f86ddfd688f5495f0` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.550939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f3799d96c50480f86ddfd688f5495f0)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:24.553114 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:24.580829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1583b0-90b9-4094-8b1f-8240b28c596f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:24.581628 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1583b0-90b9-4094-8b1f-8240b28c596f service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.581942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1583b0-90b9-4094-8b1f-8240b28c596f service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.582188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1583b0-90b9-4094-8b1f-8240b28c596f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.584401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2d1583b0-90b9-4094-8b1f-8240b28c596f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:24.606390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f3799d96c50480f86ddfd688f5495f0', 'request_id': 'req-e45d3b5c-d909-4719-baca-ad3539072191'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.613490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f3799d96c50480f86ddfd688f5495f0', 'request_id': 'req-e45d3b5c-d909-4719-baca-ad3539072191'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.619633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f3799d96c50480f86ddfd688f5495f0', 'request_id': 'req-e45d3b5c-d909-4719-baca-ad3539072191'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.635267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] The token cache is being invalidate because project 2f3799d96c50480f86ddfd688f5495f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:24.635595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.636345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e45d3b5c-d909-4719-baca-ad3539072191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:24.637966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 977/1952] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:24 2021] DELETE /identity/v3/projects/2f3799d96c50480f86ddfd688f5495f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:24.644573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ebf3b-e927-4bfe-938c-20e33553c7df None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.644865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ebf3b-e927-4bfe-938c-20e33553c7df None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.645140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ebf3b-e927-4bfe-938c-20e33553c7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.651535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1583b0-90b9-4094-8b1f-8240b28c596f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:24.653634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1583b0-90b9-4094-8b1f-8240b28c596f service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:24.675956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-984ebf3b-e927-4bfe-938c-20e33553c7df None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:24.676388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 976/1953] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:24 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:24.677382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-984ebf3b-e927-4bfe-938c-20e33553c7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:24.739887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 978/1954] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:24.747774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3e6f-8215-4027-bc08-5e613f7f0dfa None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.747980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3e6f-8215-4027-bc08-5e613f7f0dfa None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.748258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a3e6f-8215-4027-bc08-5e613f7f0dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.770557 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-cd7a3e6f-8215-4027-bc08-5e613f7f0dfa None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:24.772772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-cd7a3e6f-8215-4027-bc08-5e613f7f0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:24.781812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 977/1955] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:24.786295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ebf3b-e927-4bfe-938c-20e33553c7df None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:24.796913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ebf3b-e927-4bfe-938c-20e33553c7df None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:24.806744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:24.809386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.809800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.810130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.810974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:24.811285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:24.813063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:24.826297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 979/1956] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:24.830510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3e6f-8215-4027-bc08-5e613f7f0dfa None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:24.843461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a3e6f-8215-4027-bc08-5e613f7f0dfa None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:24.849977 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:24.850754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.851054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.851594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.852164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:24.854140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:24.898733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 978/1957] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:24 2021] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:24.902983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:24.918077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67ebb-4920-4066-b55c-61754a491b7f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:24.981962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:24.982671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:24.982908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:24.983188 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:24.983920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:24.985886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.006785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 980/1958] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:24 2021] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:25.010956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.021711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a698e9-a5f0-4c43-a1fb-18f6c1680d04 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.027494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.028154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.028448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.028699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.029418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.031002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.041201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 979/1959] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:25.045624 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.056046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230f34-8c0f-4e88-b7c5-1cd8a5197363 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.060935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9965a42-daef-43e0-9bde-07d01218b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.061590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9965a42-daef-43e0-9bde-07d01218b817 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.061875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9965a42-daef-43e0-9bde-07d01218b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.062148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9965a42-daef-43e0-9bde-07d01218b817 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.062870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9965a42-daef-43e0-9bde-07d01218b817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.064502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9965a42-daef-43e0-9bde-07d01218b817 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.075183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 981/1960] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:25.079756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.090979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482fac-b0e5-4679-89ab-cd06af04d246 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.096607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.097516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.097801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.098078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] PATH_INFO: `/v3/projects/c7c340ad24254b228eb49080cbae2d43/users/3146387210424545844585ca33d68b63/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.114482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c340ad24254b228eb49080cbae2d43, user_id=3146387210424545844585ca33d68b63, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.117210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.131591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 980/1961] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:25 2021] PUT /identity/v3/projects/c7c340ad24254b228eb49080cbae2d43/users/3146387210424545844585ca33d68b63/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:25.142186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b3ea-3e02-431c-8c09-3096cbf431fa None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.142475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b3ea-3e02-431c-8c09-3096cbf431fa None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.142751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b3ea-3e02-431c-8c09-3096cbf431fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.170330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7572b3ea-3e02-431c-8c09-3096cbf431fa None None] MFA Rules not processed for user `3146387210424545844585ca33d68b63`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:25.171694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7572b3ea-3e02-431c-8c09-3096cbf431fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:25.242267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 982/1962] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:25 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:25.247043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.316454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e6e23-954d-4c5e-b04f-4ef4e8dc58b2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.322308 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.323465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.323465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.323754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.324221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.326151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.354212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 981/1963] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:25 2021] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:25.358473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b3ea-3e02-431c-8c09-3096cbf431fa None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.369651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b3ea-3e02-431c-8c09-3096cbf431fa None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.442348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.443048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.443456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.443744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.444448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.446418 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.470290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 983/1964] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:25 2021] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:25.474631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.485620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc71d-2559-448d-9ef6-96a271fd998e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.491312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.492138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.492431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.492712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.493559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.495379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.507918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 982/1965] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:25.512386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.523297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4615b8-e9c7-4e8b-9ac9-e60cad588406 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.528619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.529522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.529803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.530076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] PATH_INFO: `/v3/projects/814dfcd725784330b8f384e6b0c2571b/users/724007d37ae241e9b145b8b8f55a5aa8/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.547540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814dfcd725784330b8f384e6b0c2571b, user_id=724007d37ae241e9b145b8b8f55a5aa8, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.550238 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.566908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 984/1966] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:25 2021] PUT /identity/v3/projects/814dfcd725784330b8f384e6b0c2571b/users/724007d37ae241e9b145b8b8f55a5aa8/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:25.571300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.581439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8758-c144-41e4-94e5-8c1e1b171cf2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.644338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98ee8c-152d-4906-9c02-3c1da01e01a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.645025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ee8c-152d-4906-9c02-3c1da01e01a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.645310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ee8c-152d-4906-9c02-3c1da01e01a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.645580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98ee8c-152d-4906-9c02-3c1da01e01a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.646343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ee8c-152d-4906-9c02-3c1da01e01a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.648106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98ee8c-152d-4906-9c02-3c1da01e01a1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.658810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 983/1967] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:25 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:25.663626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.677117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec526e-ffef-4235-8def-6b654f33b877 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.682543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.683470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.683748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.684017 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] PATH_INFO: `/v3/projects/814dfcd725784330b8f384e6b0c2571b/users/724007d37ae241e9b145b8b8f55a5aa8/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.686083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814dfcd725784330b8f384e6b0c2571b, user_id=724007d37ae241e9b145b8b8f55a5aa8, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.688805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.699243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 985/1968] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:25 2021] PUT /identity/v3/projects/814dfcd725784330b8f384e6b0c2571b/users/724007d37ae241e9b145b8b8f55a5aa8/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:25.710778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837020-4a30-498f-9613-efafbe76523f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.711075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837020-4a30-498f-9613-efafbe76523f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.711289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837020-4a30-498f-9613-efafbe76523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.742179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ba837020-4a30-498f-9613-efafbe76523f None None] MFA Rules not processed for user `724007d37ae241e9b145b8b8f55a5aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:25.743485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ba837020-4a30-498f-9613-efafbe76523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:25.828827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 984/1969] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:25 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:25.844822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:25.846959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:25.909189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13461665-1894-4348-843d-31fdae6143c0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:25.915227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:25.916006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:25.916333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:25.916742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:25.930606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:25.932273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:25.949125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 986/1970] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:25 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:26.309251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba837020-4a30-498f-9613-efafbe76523f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:26.319782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba837020-4a30-498f-9613-efafbe76523f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:26.326796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724007d37ae241e9b145b8b8f55a5aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '814dfcd725784330b8f384e6b0c2571b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:26.327518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:26.327816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:26.328098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:26.328936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:26.329452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:26.331391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:26.345013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 985/1971] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:30:26.349748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:26.360710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f496996-f334-4ae9-8485-8d90f2743b4f service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:26.366400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724007d37ae241e9b145b8b8f55a5aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '814dfcd725784330b8f384e6b0c2571b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:26.367074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:26.367405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:26.367659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:26.368412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:26.370275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:26.399380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 987/1972] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:26 2021] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:26.401715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:26.412080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53021c9-b469-4432-a7b7-262435d87f61 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:26.473596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724007d37ae241e9b145b8b8f55a5aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '814dfcd725784330b8f384e6b0c2571b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:26.474409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:26.475081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:26.475759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:26.476523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:26.476909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:26.479400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:26.497381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 986/1973] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:26.533347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:26.546510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ff36-9401-4db3-9a4f-41404c3c59e6 tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:26.551274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724007d37ae241e9b145b8b8f55a5aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '814dfcd725784330b8f384e6b0c2571b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:26.555172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:26.555502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:26.555778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] PATH_INFO: `/v3/projects/7e51903dbd004084a91241ff31660e01` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:26.557099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e51903dbd004084a91241ff31660e01)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:26.559077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:26.619470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e51903dbd004084a91241ff31660e01', 'request_id': 'req-2370dc3d-f7a9-4058-8267-ecac734b6eed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:26.626651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e51903dbd004084a91241ff31660e01', 'request_id': 'req-2370dc3d-f7a9-4058-8267-ecac734b6eed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:26.632371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e51903dbd004084a91241ff31660e01', 'request_id': 'req-2370dc3d-f7a9-4058-8267-ecac734b6eed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:26.647466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] The token cache is being invalidate because project 7e51903dbd004084a91241ff31660e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:26.647756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:26.648413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2370dc3d-f7a9-4058-8267-ecac734b6eed tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:26.650072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 988/1974] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:26 2021] DELETE /identity/v3/projects/7e51903dbd004084a91241ff31660e01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:26.844286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:26.846252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:27.068486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9fdda-5544-4ecd-9d20-45d4b5ab27df tempest-VolumeQuotaClassesTest-1008119120 tempest-VolumeQuotaClassesTest-1008119120-project-admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:27.125038 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:27.125940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:27.126218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:27.126528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] PATH_INFO: `/v3/users/3146387210424545844585ca33d68b63` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:27.127774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3146387210424545844585ca33d68b63)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:27.129809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:27.174305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:27.174597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:27.175174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:27.185690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3146387210424545844585ca33d68b63'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.195965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] MFA Rules not processed for user `b0959c5e5b1c49a9b5395f90360ce934`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:27.197260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:27.199160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3146387210424545844585ca33d68b63'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.206468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3146387210424545844585ca33d68b63'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.207172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3146387210424545844585ca33d68b63'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.216176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bdfea39f-f4a2-46ea-85d9-49538a12c3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3146387210424545844585ca33d68b63'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.222747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 987/1975] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:26 2021] DELETE /identity/v3/users/3146387210424545844585ca33d68b63 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:27.227342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:27.227659 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:27.227940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:27.246982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:27.248129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:27.255230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 989/1976] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:27 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:27.312021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 988/1977] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:27.326007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:27.326007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:27.387690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a82c94-6ba9-45b9-b8b6-2b290e702517 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:27.444546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:27.445254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:27.445519 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:27.445803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:27.455658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:27.457602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:27.468315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 990/1978] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:27.791996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:27.793537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:27.806461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e686438-8fd3-451d-90a3-8d4f95946b35 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:27.812352 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:27.813236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:27.813511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:27.813780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] PATH_INFO: `/v3/projects/c7c340ad24254b228eb49080cbae2d43` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:27.815147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c340ad24254b228eb49080cbae2d43)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:27.817150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:27.869762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c340ad24254b228eb49080cbae2d43', 'request_id': 'req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.877258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c340ad24254b228eb49080cbae2d43', 'request_id': 'req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.886314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c340ad24254b228eb49080cbae2d43', 'request_id': 'req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.899564 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] The token cache is being invalidate because project c7c340ad24254b228eb49080cbae2d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:27.899837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.900567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:27.902186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 989/1979] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:27 2021] DELETE /identity/v3/projects/c7c340ad24254b228eb49080cbae2d43 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:27.906666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:27.932465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da1bd5-55ed-4a5a-86dc-25e6464328d8 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:27.993365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:27.994678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:27.995003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:27.995334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] PATH_INFO: `/v3/users/724007d37ae241e9b145b8b8f55a5aa8` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:27.997243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=724007d37ae241e9b145b8b8f55a5aa8)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:27.999297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:28.049821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724007d37ae241e9b145b8b8f55a5aa8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.057360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724007d37ae241e9b145b8b8f55a5aa8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.058026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724007d37ae241e9b145b8b8f55a5aa8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.070296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724007d37ae241e9b145b8b8f55a5aa8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.071005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b332dfd-0120-4c2e-970e-9d0363c6c1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724007d37ae241e9b145b8b8f55a5aa8'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.086980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 991/1980] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:27 2021] DELETE /identity/v3/users/724007d37ae241e9b145b8b8f55a5aa8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:28.393645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:28.395220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:28.408959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e50a5-ac9a-4aba-89c7-0c06de365c0f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:28.478148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:28.479010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.479285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.479582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] PATH_INFO: `/v3/projects/814dfcd725784330b8f384e6b0c2571b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.480854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814dfcd725784330b8f384e6b0c2571b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:28.482764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:28.532587 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814dfcd725784330b8f384e6b0c2571b', 'request_id': 'req-0f09a766-7a72-4194-867e-851e3a8ce3f7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.540888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814dfcd725784330b8f384e6b0c2571b', 'request_id': 'req-0f09a766-7a72-4194-867e-851e3a8ce3f7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.550730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814dfcd725784330b8f384e6b0c2571b', 'request_id': 'req-0f09a766-7a72-4194-867e-851e3a8ce3f7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.566765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] The token cache is being invalidate because project 814dfcd725784330b8f384e6b0c2571b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:28.567064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.567923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-0f09a766-7a72-4194-867e-851e3a8ce3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:28.569922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 990/1981] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:28 2021] DELETE /identity/v3/projects/814dfcd725784330b8f384e6b0c2571b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:28.576034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d7cca-ac60-4465-a9aa-084d5a0ff96f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.576547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d7cca-ac60-4465-a9aa-084d5a0ff96f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.576547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d7cca-ac60-4465-a9aa-084d5a0ff96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.600382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-066d7cca-ac60-4465-a9aa-084d5a0ff96f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:28.601488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-066d7cca-ac60-4465-a9aa-084d5a0ff96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:28.669485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 992/1982] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:28.677651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5a7e-c5a1-4628-94fa-b1784a32fcf0 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.678195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5a7e-c5a1-4628-94fa-b1784a32fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.678571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae5a7e-c5a1-4628-94fa-b1784a32fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.701957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1fae5a7e-c5a1-4628-94fa-b1784a32fcf0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:28.703260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1fae5a7e-c5a1-4628-94fa-b1784a32fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:28.711631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 991/1983] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:28.715833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d7cca-ac60-4465-a9aa-084d5a0ff96f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:28.726518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d7cca-ac60-4465-a9aa-084d5a0ff96f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:28.731916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:28.732604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.732888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.733165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.733905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:28.734214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:28.735866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:28.756831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 993/1984] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:28.760460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae5a7e-c5a1-4628-94fa-b1784a32fcf0 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:28.769445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae5a7e-c5a1-4628-94fa-b1784a32fcf0 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:28.774221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:28.774887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.775164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.775475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.776174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:28.778321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:28.807399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 992/1985] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:28 2021] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:28.809663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:28.819906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360b80d-3d96-41c2-8e1d-be1b99f43751 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:28.896293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:28.897785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.898067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.898348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.899077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:28.901413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:28.925626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 994/1986] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:28 2021] POST /identity/v3/users => generated 305 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:28.930715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:28.941977 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becf064-c8be-47e8-9503-c710557fa245 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:28.949306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:28.950059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.950547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.950911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.951752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:28.954893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:28.970282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 993/1987] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:28 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:28.975853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:28.985961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40968-2318-4c93-b796-b0d03d4362c7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:28.992038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab95527-774f-4175-8d74-7a1c8e3065d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:28.992681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95527-774f-4175-8d74-7a1c8e3065d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:28.993040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95527-774f-4175-8d74-7a1c8e3065d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:28.993309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab95527-774f-4175-8d74-7a1c8e3065d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:28.994076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab95527-774f-4175-8d74-7a1c8e3065d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:28.995720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab95527-774f-4175-8d74-7a1c8e3065d0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.005941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 995/1988] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:29.011565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.022709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d628-fc4e-443d-b518-bac36a8922d7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.028333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.029249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.029530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.029805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] PATH_INFO: `/v3/projects/4affb607d1614496821dc2e06f0e6c19/users/d885f635a8d8444db67ae7acc3a9f206/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.047252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4affb607d1614496821dc2e06f0e6c19, user_id=d885f635a8d8444db67ae7acc3a9f206, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.050352 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.072839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 994/1989] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:29 2021] PUT /identity/v3/projects/4affb607d1614496821dc2e06f0e6c19/users/d885f635a8d8444db67ae7acc3a9f206/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:29.085165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22a6e-c753-4ea8-b754-4d2b8f9e4d1a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.085592 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22a6e-c753-4ea8-b754-4d2b8f9e4d1a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.086968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b22a6e-c753-4ea8-b754-4d2b8f9e4d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.118732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-39b22a6e-c753-4ea8-b754-4d2b8f9e4d1a None None] MFA Rules not processed for user `d885f635a8d8444db67ae7acc3a9f206`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:29.118732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-39b22a6e-c753-4ea8-b754-4d2b8f9e4d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:29.184313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 996/1990] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:29 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:29.188948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.288318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7c301-80b4-4a80-97ad-58721f04c78c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.295316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.296020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.296302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.296580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.297309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.299168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.335602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 995/1991] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:29 2021] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:29.340427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22a6e-c753-4ea8-b754-4d2b8f9e4d1a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.352119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b22a6e-c753-4ea8-b754-4d2b8f9e4d1a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.422871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.423681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.423896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.424168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.424995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.427385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.451443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 997/1992] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:29 2021] POST /identity/v3/users => generated 311 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:29.454503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.466222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d38f8-6119-4b01-8870-7d5576853c1d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.471086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.471797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.472083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.472361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.473097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.474776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.486731 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 996/1993] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:29.491225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.503048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867cd0d-53fb-4eaa-85a2-6b81e705f296 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.508497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.509472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.509830 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.510160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] PATH_INFO: `/v3/projects/1aff8f5ffbb44f4d8ac46e2e493eb98f/users/a3d087795cd54eb2920818e90aaff288/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.525988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aff8f5ffbb44f4d8ac46e2e493eb98f, user_id=a3d087795cd54eb2920818e90aaff288, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.528755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.542146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 998/1994] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:29 2021] PUT /identity/v3/projects/1aff8f5ffbb44f4d8ac46e2e493eb98f/users/a3d087795cd54eb2920818e90aaff288/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:29.546266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.559403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fcacc-af21-47e4-8abc-011378b3e130 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.618767 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d7e0d-37b4-4f55-886b-5bf48b2ed84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.619501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d7e0d-37b4-4f55-886b-5bf48b2ed84d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.619777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d7e0d-37b4-4f55-886b-5bf48b2ed84d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.620058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d7e0d-37b4-4f55-886b-5bf48b2ed84d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.620792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d7e0d-37b4-4f55-886b-5bf48b2ed84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.622386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d7e0d-37b4-4f55-886b-5bf48b2ed84d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.633699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 997/1995] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:29.638275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.649511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acc3ab-b1a7-4243-b804-5cebdd070d39 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.655173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.656139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.656560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.656714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] PATH_INFO: `/v3/projects/1aff8f5ffbb44f4d8ac46e2e493eb98f/users/a3d087795cd54eb2920818e90aaff288/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.658911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aff8f5ffbb44f4d8ac46e2e493eb98f, user_id=a3d087795cd54eb2920818e90aaff288, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.661604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.673121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 999/1996] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:29 2021] PUT /identity/v3/projects/1aff8f5ffbb44f4d8ac46e2e493eb98f/users/a3d087795cd54eb2920818e90aaff288/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:29.685671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.686093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.686406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.714966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] MFA Rules not processed for user `a3d087795cd54eb2920818e90aaff288`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:29.716226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:29.791884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 998/1997] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:29 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:29.804283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:29.808564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:29.869797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82790-999b-4276-8ced-349c5e19f19a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:29.873803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:29.874458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:29.874738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:29.875012 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:29.888102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:29.889560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:29.899021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1000/1998] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:29 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:30.065805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:30.067477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:30.087329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2a921-293f-40fa-833d-d7b7e9fd41dd None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:30.091808 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0054b-25ae-471c-8ef7-d97cb548fc22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:30.092507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0054b-25ae-471c-8ef7-d97cb548fc22 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:30.092787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0054b-25ae-471c-8ef7-d97cb548fc22 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:30.093061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0054b-25ae-471c-8ef7-d97cb548fc22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:30.163956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0054b-25ae-471c-8ef7-d97cb548fc22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:30.168450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0054b-25ae-471c-8ef7-d97cb548fc22 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:30.177270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 999/1999] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:30 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:39.732590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:39.810710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45cf87-e6b7-4128-b7dd-c43befa84b68 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:39.819865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:39.820682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:39.820962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:39.821233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] PATH_INFO: `/v3/users/d885f635a8d8444db67ae7acc3a9f206` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:39.822581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d885f635a8d8444db67ae7acc3a9f206)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:39.824589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:39.879977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd885f635a8d8444db67ae7acc3a9f206'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:39.888788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd885f635a8d8444db67ae7acc3a9f206'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:39.889704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd885f635a8d8444db67ae7acc3a9f206'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:39.904814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd885f635a8d8444db67ae7acc3a9f206'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:39.905598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd885f635a8d8444db67ae7acc3a9f206'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:39.921227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1001/2000] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:39 2021] DELETE /identity/v3/users/d885f635a8d8444db67ae7acc3a9f206 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:39.925862 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:39.926347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:39.926440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:39.943850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:39.945138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:40.004735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1000/2001] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:40.014872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:40.016653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:40.201262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d03cb7-aac8-47f6-99d7-ff31fee57933 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:40.206724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:40.207676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:40.208047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:40.208332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:40.218386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:40.219861 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:40.230115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1002/2002] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:40.945270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:40.946934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:40.961444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83857ef4-8e9b-46df-9c95-f3963c904c83 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:40.967540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:40.968514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:40.968892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:40.969269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] PATH_INFO: `/v3/projects/4affb607d1614496821dc2e06f0e6c19` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:40.970708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4affb607d1614496821dc2e06f0e6c19)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:40.972762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:41.035978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4affb607d1614496821dc2e06f0e6c19', 'request_id': 'req-f4844f66-c6ba-4afb-9774-a5f17fa29abf'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.043389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4affb607d1614496821dc2e06f0e6c19', 'request_id': 'req-f4844f66-c6ba-4afb-9774-a5f17fa29abf'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.054183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4affb607d1614496821dc2e06f0e6c19', 'request_id': 'req-f4844f66-c6ba-4afb-9774-a5f17fa29abf'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.066633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] The token cache is being invalidate because project 4affb607d1614496821dc2e06f0e6c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:41.067724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.069011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.070986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1001/2003] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:40 2021] DELETE /identity/v3/projects/4affb607d1614496821dc2e06f0e6c19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:41.074723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:41.087117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0541453-f47e-4ef5-90dc-e63a561d4288 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:41.145806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:41.146727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:41.147009 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:41.147278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] PATH_INFO: `/v3/users/a3d087795cd54eb2920818e90aaff288` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:41.148570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d087795cd54eb2920818e90aaff288)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:41.150483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:41.202043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d087795cd54eb2920818e90aaff288'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.209344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d087795cd54eb2920818e90aaff288'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.210039 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d087795cd54eb2920818e90aaff288'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.221792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d087795cd54eb2920818e90aaff288'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.222616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-62017f93-a33a-4f97-868d-c6821773f392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d087795cd54eb2920818e90aaff288'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.239171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1003/2004] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:41 2021] DELETE /identity/v3/users/a3d087795cd54eb2920818e90aaff288 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:41.613774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:41.615810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:41.628971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4844f66-c6ba-4afb-9774-a5f17fa29abf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:41.694928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:41.695874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:41.696157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:41.696432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] PATH_INFO: `/v3/projects/1aff8f5ffbb44f4d8ac46e2e493eb98f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:41.697640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aff8f5ffbb44f4d8ac46e2e493eb98f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:41.699619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:41.757325 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aff8f5ffbb44f4d8ac46e2e493eb98f', 'request_id': 'req-df034ad2-fd5b-4477-a654-b46312b59450'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.763934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aff8f5ffbb44f4d8ac46e2e493eb98f', 'request_id': 'req-df034ad2-fd5b-4477-a654-b46312b59450'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.773785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aff8f5ffbb44f4d8ac46e2e493eb98f', 'request_id': 'req-df034ad2-fd5b-4477-a654-b46312b59450'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.785438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] The token cache is being invalidate because project 1aff8f5ffbb44f4d8ac46e2e493eb98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:41.785728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.786391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-df034ad2-fd5b-4477-a654-b46312b59450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.788297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1002/2005] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:41 2021] DELETE /identity/v3/projects/1aff8f5ffbb44f4d8ac46e2e493eb98f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:41.794173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:41.794497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:41.794779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:41.818800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:41.820193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:41.881967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1004/2006] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:41.891153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80549f-581c-41a2-b499-67b8421dce08 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:41.891554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80549f-581c-41a2-b499-67b8421dce08 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:41.891953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80549f-581c-41a2-b499-67b8421dce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:41.902037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:41.904377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:41.913558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8f80549f-581c-41a2-b499-67b8421dce08 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:41.914784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8f80549f-581c-41a2-b499-67b8421dce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:41.923620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1003/2007] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:41.926392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833cfa4-4808-4c72-a551-bdbabb39fd21 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:41.928128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80549f-581c-41a2-b499-67b8421dce08 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:41.934876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:41.934876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:41.934876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:41.934876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] PATH_INFO: `/v3/users/f156aa45a8d64fedaaa9df544ba4d92e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:41.936072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f156aa45a8d64fedaaa9df544ba4d92e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:41.937870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80549f-581c-41a2-b499-67b8421dce08 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:41.938004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:41.942974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:41.944101 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:41.945086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:41.945086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:41.945707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:41.946235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:41.948097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:41.962954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1004/2008] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:41.966504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:41.978076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72ab83-c564-4e76-af03-3ba1e0cec900 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:41.983546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:41.984396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:41.984907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:41.985353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:41.986350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:41.987581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f156aa45a8d64fedaaa9df544ba4d92e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.988711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:41.995546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f156aa45a8d64fedaaa9df544ba4d92e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:41.996413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f156aa45a8d64fedaaa9df544ba4d92e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.011664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f156aa45a8d64fedaaa9df544ba4d92e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.012517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f156aa45a8d64fedaaa9df544ba4d92e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.026919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1005/2009] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:41 2021] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:42.028244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.028823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1005/2010] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:41 2021] DELETE /identity/v3/users/f156aa45a8d64fedaaa9df544ba4d92e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:42.029954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:42.107403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01057031-e5d7-4543-a861-cc887de26dd1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.170827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.171641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.171936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.172043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.173210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.174772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.200690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1006/2011] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:42 2021] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:42.205382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.217203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b2b24-e030-4636-8c63-8970362ff036 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.232237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.232927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.233209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.233487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.234232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.235881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.240523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.242562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:42.250232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1006/2012] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:42 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:42.260873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.265252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb21f6-330d-4d61-b5ee-ead3c0b993f1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.272485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438381c9-8bfb-4828-9d6a-99b7498eaba2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.273729 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.275307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.275799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.276338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] PATH_INFO: `/v3/projects/e15f14b108b54811bd061d2f3cc4150d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.277462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.278126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.278331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15f14b108b54811bd061d2f3cc4150d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.278433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.278670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.279601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.281189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.281676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.292687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1007/2013] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:42 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:42.296934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.311441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaacda-bba1-4c3d-882c-45b3c2ed7c45 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.324218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf8901-c43e-47ca-b1b3-92ae51732ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.325643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8901-c43e-47ca-b1b3-92ae51732ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.326241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8901-c43e-47ca-b1b3-92ae51732ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.326880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf8901-c43e-47ca-b1b3-92ae51732ebc admin admin] PATH_INFO: `/v3/projects/75ece42baa1e4b6eae0affcf0d672bdd/users/eb815c1ba7414a66a2cd36acac4ed8e1/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.349073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf8901-c43e-47ca-b1b3-92ae51732ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ece42baa1e4b6eae0affcf0d672bdd, user_id=eb815c1ba7414a66a2cd36acac4ed8e1, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.353673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf8901-c43e-47ca-b1b3-92ae51732ebc admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.355264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15f14b108b54811bd061d2f3cc4150d', 'request_id': 'req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.364464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15f14b108b54811bd061d2f3cc4150d', 'request_id': 'req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.374476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1008/2014] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:42 2021] PUT /identity/v3/projects/75ece42baa1e4b6eae0affcf0d672bdd/users/eb815c1ba7414a66a2cd36acac4ed8e1/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:42.376046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15f14b108b54811bd061d2f3cc4150d', 'request_id': 'req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.388038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.388476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.389159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.393658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] The token cache is being invalidate because project e15f14b108b54811bd061d2f3cc4150d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:42.394696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.395503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.397806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1007/2015] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:42 2021] DELETE /identity/v3/projects/e15f14b108b54811bd061d2f3cc4150d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:42.402506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.406039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:42.432074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] MFA Rules not processed for user `eb815c1ba7414a66a2cd36acac4ed8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:42.433395 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:42.501489 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da6cbf-50b5-49a3-84ad-4a4539a1ce3c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.509473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1009/2016] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:42 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:42.514043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.515595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:42.563552 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.564436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.564717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.564994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] PATH_INFO: `/v3/users/ca33dbd3192242ca8cc2b9c61810e06b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.566205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca33dbd3192242ca8cc2b9c61810e06b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.568793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.585352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc68075-074c-4284-b43e-ab19c15bc366 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.590706 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.591392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.591684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.591958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.592693 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.594759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.620370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca33dbd3192242ca8cc2b9c61810e06b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.627614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1010/2017] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:42 2021] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:42.632158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.632778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca33dbd3192242ca8cc2b9c61810e06b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.639974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca33dbd3192242ca8cc2b9c61810e06b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.640797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca33dbd3192242ca8cc2b9c61810e06b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.650051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca33dbd3192242ca8cc2b9c61810e06b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.657602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1008/2018] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:42 2021] DELETE /identity/v3/users/ca33dbd3192242ca8cc2b9c61810e06b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:42.739057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfdfe1-9ae4-4b5d-b2a4-e7cf2651dbc9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.834813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.835541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.835823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.837449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.837449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.839463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.862678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1011/2019] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:42 2021] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:42.867671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.869515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:42.877968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.879667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:42.883510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8e7d7-eba1-44ed-80f7-326d4826f737 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.890881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.891598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.891878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.892154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.892890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.894488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.897656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607899b-bad0-4778-993c-b383a32cd4b8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.905960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1009/2020] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:42 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:42.909937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.910383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.911258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.911757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.912239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] PATH_INFO: `/v3/projects/c0841ae69d444961bd38ab563c31821c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.913699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0841ae69d444961bd38ab563c31821c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.915651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.924696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759200e5-88ab-4e77-8f89-3481e2c4a9d3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:42.929749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:42.930707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:42.931018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:42.931379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] PATH_INFO: `/v3/projects/4fa18784956d486b99232a5550591897/users/4a1bc49cee114b89acb0c978f4b11a00/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:42.948385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa18784956d486b99232a5550591897, user_id=4a1bc49cee114b89acb0c978f4b11a00, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:42.951835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:42.966132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1010/2021] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:42 2021] PUT /identity/v3/projects/4fa18784956d486b99232a5550591897/users/4a1bc49cee114b89acb0c978f4b11a00/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:42.970035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:42.970200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0841ae69d444961bd38ab563c31821c', 'request_id': 'req-51480c33-364c-4c67-860a-8cd4b7d3f402'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.976475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0841ae69d444961bd38ab563c31821c', 'request_id': 'req-51480c33-364c-4c67-860a-8cd4b7d3f402'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.981762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0841ae69d444961bd38ab563c31821c', 'request_id': 'req-51480c33-364c-4c67-860a-8cd4b7d3f402'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.994743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] The token cache is being invalidate because project c0841ae69d444961bd38ab563c31821c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:42.995032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.995692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-51480c33-364c-4c67-860a-8cd4b7d3f402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:42.997249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1012/2022] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:42 2021] DELETE /identity/v3/projects/c0841ae69d444961bd38ab563c31821c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:43.007818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a47e-816e-4e9f-ad86-d49f38bee60e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.008074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a47e-816e-4e9f-ad86-d49f38bee60e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.008374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a47e-816e-4e9f-ad86-d49f38bee60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.026371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7371a47e-816e-4e9f-ad86-d49f38bee60e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:43.027579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7371a47e-816e-4e9f-ad86-d49f38bee60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:43.035377 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1013/2023] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:43.035607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf1c6-a44d-430f-8091-0f7ec81979d1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.040567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.041251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.041532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.041804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.042889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.044050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913bc7-eeb4-4980-883a-b2c07d0f65dc None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.044469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913bc7-eeb4-4980-883a-b2c07d0f65dc None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.044745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913bc7-eeb4-4980-883a-b2c07d0f65dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.044898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.056254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1011/2024] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:42 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:43.060982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.063293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:43.063725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d6913bc7-eeb4-4980-883a-b2c07d0f65dc None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:43.065059 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d6913bc7-eeb4-4980-883a-b2c07d0f65dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:43.075105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1014/2025] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:43.077664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913bc7-eeb4-4980-883a-b2c07d0f65dc None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.077944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fdf17-dfda-4b43-b7cd-3654cf8528e0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.082833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd11719-093a-4885-a881-3b8a2fb73df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.083797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11719-093a-4885-a881-3b8a2fb73df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.084108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11719-093a-4885-a881-3b8a2fb73df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.084520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd11719-093a-4885-a881-3b8a2fb73df8 admin admin] PATH_INFO: `/v3/projects/4fa18784956d486b99232a5550591897/users/4a1bc49cee114b89acb0c978f4b11a00/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.087798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913bc7-eeb4-4980-883a-b2c07d0f65dc None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.088220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd11719-093a-4885-a881-3b8a2fb73df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa18784956d486b99232a5550591897, user_id=4a1bc49cee114b89acb0c978f4b11a00, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.091794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd11719-093a-4885-a881-3b8a2fb73df8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.093040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.093691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.093967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.094234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.095120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:43.095403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.097019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.103639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1012/2026] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:43 2021] PUT /identity/v3/projects/4fa18784956d486b99232a5550591897/users/4a1bc49cee114b89acb0c978f4b11a00/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:43.113754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615739cd-feea-4b21-94c0-84862eb370f6 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.114035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615739cd-feea-4b21-94c0-84862eb370f6 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.114307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615739cd-feea-4b21-94c0-84862eb370f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.116100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1015/2027] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:30:43.120454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.130600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1e6b5-0278-40fc-b121-ed3cd3890c6b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.144132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-615739cd-feea-4b21-94c0-84862eb370f6 None None] MFA Rules not processed for user `4a1bc49cee114b89acb0c978f4b11a00`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:43.145538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-615739cd-feea-4b21-94c0-84862eb370f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:43.195157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.195899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.196256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.196519 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.197222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.200450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.227512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1013/2028] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:43 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:43.231510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1016/2029] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:43 2021] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:43.233783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615739cd-feea-4b21-94c0-84862eb370f6 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.239122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.241227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:43.245421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615739cd-feea-4b21-94c0-84862eb370f6 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.301513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf4db-7e42-4f87-9ed5-2d701b5de9cf admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.305683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.306363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.306634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.306909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.313239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.313921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.314205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.314480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.315177 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.317138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.337275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1014/2030] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:43 2021] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:43.341393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.351798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb85c39-9ae5-43ec-b6c1-558fd113922c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.356816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.357493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.357778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.358064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.358867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.360684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.374890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1015/2031] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:43.375116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.375965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.376394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.385867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a95f7-4397-4dba-81a9-99e8ac8c6d9c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.386569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1017/2032] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:43 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:43.394800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdd909-2922-4672-9cda-e3cfd71fbb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.394800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdd909-2922-4672-9cda-e3cfd71fbb34 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.394800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdd909-2922-4672-9cda-e3cfd71fbb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.394800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdd909-2922-4672-9cda-e3cfd71fbb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.396026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdd909-2922-4672-9cda-e3cfd71fbb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.396026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdd909-2922-4672-9cda-e3cfd71fbb34 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.405585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1016/2033] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:43.410204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.422337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089377ed-80b9-4f3a-be9c-6a6fa851daae service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.427506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.428409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.428683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.428956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] PATH_INFO: `/v3/projects/7e5d64c304a04c25bc0ba0a948d46887/users/bbba31cf278346d2b1ee3180a729dba2/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.447833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5d64c304a04c25bc0ba0a948d46887, user_id=bbba31cf278346d2b1ee3180a729dba2, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.450615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.465314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1018/2034] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:43 2021] PUT /identity/v3/projects/7e5d64c304a04c25bc0ba0a948d46887/users/bbba31cf278346d2b1ee3180a729dba2/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:43.479727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25c700-ecfc-48cd-8eef-90e8696ee3ad None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.480084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25c700-ecfc-48cd-8eef-90e8696ee3ad None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.480420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25c700-ecfc-48cd-8eef-90e8696ee3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.512713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3a25c700-ecfc-48cd-8eef-90e8696ee3ad None None] MFA Rules not processed for user `bbba31cf278346d2b1ee3180a729dba2`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:43.515497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3a25c700-ecfc-48cd-8eef-90e8696ee3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:43.589619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1017/2035] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:43 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:43.600449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.602297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:43.668392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee53155-9cc0-4526-8a48-1ca2b7475406 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.672033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba957e77-96b9-4669-833d-d31e7ec5094b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.672681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba957e77-96b9-4669-833d-d31e7ec5094b service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.672959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba957e77-96b9-4669-833d-d31e7ec5094b service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.673230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba957e77-96b9-4669-833d-d31e7ec5094b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.682101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba957e77-96b9-4669-833d-d31e7ec5094b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.683563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba957e77-96b9-4669-833d-d31e7ec5094b service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.693791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1019/2036] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:43 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:43.730538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25c700-ecfc-48cd-8eef-90e8696ee3ad None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:43.794162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25c700-ecfc-48cd-8eef-90e8696ee3ad None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:43.800306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:43.801125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.801460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.801788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] PATH_INFO: `/v3/users/eb815c1ba7414a66a2cd36acac4ed8e1` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.803403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb815c1ba7414a66a2cd36acac4ed8e1)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:43.805860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:43.884991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb815c1ba7414a66a2cd36acac4ed8e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:43.899593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb815c1ba7414a66a2cd36acac4ed8e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:43.906843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb815c1ba7414a66a2cd36acac4ed8e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:43.908531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb815c1ba7414a66a2cd36acac4ed8e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:43.923515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb815c1ba7414a66a2cd36acac4ed8e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:43.933656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1018/2037] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:43 2021] DELETE /identity/v3/users/eb815c1ba7414a66a2cd36acac4ed8e1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:43.938760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:43.940687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:43.941121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:43.961814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:43.975312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:44.060809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1020/2038] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:44.078507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:44.080108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:44.152840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b18da-5b53-45e8-9f8e-7975b7975d6f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:44.158474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:44.159326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:44.159813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:44.160137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:44.183546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:44.185320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:44.204715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1019/2039] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:44.652788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:44.654823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:44.671339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d7dfb-ab6e-4b9f-818a-6d8230c79439 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:44.677870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:44.678821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:44.680367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:44.682101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] PATH_INFO: `/v3/projects/75ece42baa1e4b6eae0affcf0d672bdd` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:44.686007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ece42baa1e4b6eae0affcf0d672bdd)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:44.690474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:44.706210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:44.708243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:44.727263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0432fa-9761-4bf8-bda9-f1467f1e7078 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:44.749293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:44.750555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:44.751070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:44.752456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] PATH_INFO: `/v3/users/b514a1dc3cc642f2b83ba52eb39b4420` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:44.754775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b514a1dc3cc642f2b83ba52eb39b4420)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:44.758277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:44.765903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ece42baa1e4b6eae0affcf0d672bdd', 'request_id': 'req-43bcd219-d158-4e7e-9f36-741e9f5959ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.773661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ece42baa1e4b6eae0affcf0d672bdd', 'request_id': 'req-43bcd219-d158-4e7e-9f36-741e9f5959ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.785896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ece42baa1e4b6eae0affcf0d672bdd', 'request_id': 'req-43bcd219-d158-4e7e-9f36-741e9f5959ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.801185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] The token cache is being invalidate because project 75ece42baa1e4b6eae0affcf0d672bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:44.801562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.802953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.805037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1021/2040] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:44 2021] DELETE /identity/v3/projects/75ece42baa1e4b6eae0affcf0d672bdd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:44.809113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:44.810585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:44.822041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b514a1dc3cc642f2b83ba52eb39b4420'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.841342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b514a1dc3cc642f2b83ba52eb39b4420'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.851949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b514a1dc3cc642f2b83ba52eb39b4420'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.853030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b514a1dc3cc642f2b83ba52eb39b4420'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.864848 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b514a1dc3cc642f2b83ba52eb39b4420'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:44.876582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1020/2041] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:44 2021] DELETE /identity/v3/users/b514a1dc3cc642f2b83ba52eb39b4420 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:44.893747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd219-d158-4e7e-9f36-741e9f5959ce admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:44.979284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:44.980138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:44.980422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:44.980664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] PATH_INFO: `/v3/users/4a1bc49cee114b89acb0c978f4b11a00` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:44.981892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1bc49cee114b89acb0c978f4b11a00)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:44.983863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.049196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1bc49cee114b89acb0c978f4b11a00'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.062151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1bc49cee114b89acb0c978f4b11a00'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.063207 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1bc49cee114b89acb0c978f4b11a00'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.082045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1bc49cee114b89acb0c978f4b11a00'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.082880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d765561-0763-47f2-9f41-f5cf521ed7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1bc49cee114b89acb0c978f4b11a00'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.098691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.099818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1022/2042] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:44 2021] DELETE /identity/v3/users/4a1bc49cee114b89acb0c978f4b11a00 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:45.101241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:45.130074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840675-b72b-4b22-b8e7-15783d7de347 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.226806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.227607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.227890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.228168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] PATH_INFO: `/v3/projects/dba5a01bf20b47e4a67299b2f5aa032b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.229444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba5a01bf20b47e4a67299b2f5aa032b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.231624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.289871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba5a01bf20b47e4a67299b2f5aa032b', 'request_id': 'req-a1f8190a-cc13-40a6-81be-a4868391bbf2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.296332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba5a01bf20b47e4a67299b2f5aa032b', 'request_id': 'req-a1f8190a-cc13-40a6-81be-a4868391bbf2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.306904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba5a01bf20b47e4a67299b2f5aa032b', 'request_id': 'req-a1f8190a-cc13-40a6-81be-a4868391bbf2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.321669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] The token cache is being invalidate because project dba5a01bf20b47e4a67299b2f5aa032b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:45.321913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.322586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a1f8190a-cc13-40a6-81be-a4868391bbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.324471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1021/2043] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:45 2021] DELETE /identity/v3/projects/dba5a01bf20b47e4a67299b2f5aa032b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:45.334456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.334456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.334456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.349037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:45.350873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:45.424746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1023/2044] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:45.433271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fddc5-a75d-470a-9b8b-7759f41fa7e7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.433584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fddc5-a75d-470a-9b8b-7759f41fa7e7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.433861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fddc5-a75d-470a-9b8b-7759f41fa7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.457999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-614fddc5-a75d-470a-9b8b-7759f41fa7e7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:45.458194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.459384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-614fddc5-a75d-470a-9b8b-7759f41fa7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:45.459825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:45.468798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1022/2045] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:45.473214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fddc5-a75d-470a-9b8b-7759f41fa7e7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.474152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b932e4-0ebb-437e-864d-f834b3731500 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.480304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.481344 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.482183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.482531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] PATH_INFO: `/v3/projects/4fa18784956d486b99232a5550591897` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.483413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fddc5-a75d-470a-9b8b-7759f41fa7e7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.488139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.488819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.489005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.489278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.490214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:45.490519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.490899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa18784956d486b99232a5550591897)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.492172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.493203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.514868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1023/2046] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:30:45.515810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.528084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c331f0-d068-4e5c-acc7-fef8f0a2d20c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.549934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa18784956d486b99232a5550591897', 'request_id': 'req-5dcb82c0-73f5-4213-a457-d1d5892b6520'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.557596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa18784956d486b99232a5550591897', 'request_id': 'req-5dcb82c0-73f5-4213-a457-d1d5892b6520'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.563843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa18784956d486b99232a5550591897', 'request_id': 'req-5dcb82c0-73f5-4213-a457-d1d5892b6520'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.579056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] The token cache is being invalidate because project 4fa18784956d486b99232a5550591897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:45.579564 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.580401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-5dcb82c0-73f5-4213-a457-d1d5892b6520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:45.582119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1024/2047] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:45 2021] DELETE /identity/v3/projects/4fa18784956d486b99232a5550591897 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:45.590977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb92f87-0525-403b-bcfa-68b75366b6ef None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.590977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb92f87-0525-403b-bcfa-68b75366b6ef None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.590977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb92f87-0525-403b-bcfa-68b75366b6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.598251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.599633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.599826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.600117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.602037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.602725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.606884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-deb92f87-0525-403b-bcfa-68b75366b6ef None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:45.608183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-deb92f87-0525-403b-bcfa-68b75366b6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:45.616536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1025/2048] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:45.625118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb7be3-ca5b-43ef-821f-7c467fdc369f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.625467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb7be3-ca5b-43ef-821f-7c467fdc369f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.625822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb7be3-ca5b-43ef-821f-7c467fdc369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.650722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1024/2049] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/projects => generated 391 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:45.652372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.658679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:45.670708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-addb7be3-ca5b-43ef-821f-7c467fdc369f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:45.672146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-addb7be3-ca5b-43ef-821f-7c467fdc369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:45.742040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f672-fcf5-4458-81dd-1966b5eff106 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.748248 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.749373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.749667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.750419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.751433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.753602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.777943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1025/2050] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:45.783679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.798990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29483660-b4db-43ec-b7a9-b87571352582 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.805126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.806924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1026/2051] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:45.807534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.807959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.808351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.808609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb7be3-ca5b-43ef-821f-7c467fdc369f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.809417 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.811736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.819335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb7be3-ca5b-43ef-821f-7c467fdc369f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.824548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.825413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.825852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.826272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.826499 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1026/2052] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:45.827362 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:45.827678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.829331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.830393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.845453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1027/2053] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:45.848816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.855829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a963c5-8df9-4bd2-8c66-91eae14a2ec3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.861648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3634b8-1a1a-4d49-8221-7134db8a2e4d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:45.868040 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.869644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.870065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:45.870371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.870764 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:45.871076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:45.871180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.871400 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:45.872096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.872518 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:45.874626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.881484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:45.913836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1027/2054] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:45.921190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1028/2055] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:45.922550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.924069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:45.935863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7299190-f869-42e5-9814-3f29de438101 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.018418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ba8bd-63ad-4399-b31c-87038a1efdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.019492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba8bd-63ad-4399-b31c-87038a1efdf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.019860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba8bd-63ad-4399-b31c-87038a1efdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.020211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ba8bd-63ad-4399-b31c-87038a1efdf2 admin admin] PATH_INFO: `/v3/projects/dec8900e772c45c583c5e85e9958d95d/users/81d8642de4a64b80b0a85d69663e2f91/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.021493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0675150-da18-4a3a-90a1-648bf945b59b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.036628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.037676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.038096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.038615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.039335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.044662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.046697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ba8bd-63ad-4399-b31c-87038a1efdf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec8900e772c45c583c5e85e9958d95d, user_id=81d8642de4a64b80b0a85d69663e2f91, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.050228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ba8bd-63ad-4399-b31c-87038a1efdf2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.079220 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1029/2056] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:45 2021] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:46.079319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1028/2057] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:45 2021] PUT /identity/v3/projects/dec8900e772c45c583c5e85e9958d95d/users/81d8642de4a64b80b0a85d69663e2f91/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:46.081823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.085042 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.085471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.085888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.100513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fe666-6653-414e-9d81-ff16894ee2e4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.106118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:46.107381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:46.170308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.171176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.171437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.171754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.172494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.173123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1029/2058] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:46.183603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.190980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.192784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:46.200761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1030/2059] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:46 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:46.207959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.219254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854d3a4-9426-4205-968d-bfc558eeccec admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.224642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.225673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.226025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.226371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.227218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.229789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.243296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1031/2060] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:46 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:46.247285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.258510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779047e4-3fa2-444b-b350-b4ee95100bca admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.265093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.266133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.266475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.266761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] PATH_INFO: `/v3/projects/6b44aae288424ddd905fcc6f752411cc/users/dcb0a4a9fd1f4903a4cf5edacb06eef3/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.267242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3996c-ae61-4306-a955-4e190c69ff68 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.271123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0ec7d-5f54-4d44-9a92-2e777739cfbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.271987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ec7d-5f54-4d44-9a92-2e777739cfbd service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.272270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ec7d-5f54-4d44-9a92-2e777739cfbd service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.272547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ec7d-5f54-4d44-9a92-2e777739cfbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.283202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0ec7d-5f54-4d44-9a92-2e777739cfbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.284807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0ec7d-5f54-4d44-9a92-2e777739cfbd service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.289750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b44aae288424ddd905fcc6f752411cc, user_id=dcb0a4a9fd1f4903a4cf5edacb06eef3, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.292473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.295703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1030/2061] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:46.311105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1032/2062] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:46 2021] PUT /identity/v3/projects/6b44aae288424ddd905fcc6f752411cc/users/dcb0a4a9fd1f4903a4cf5edacb06eef3/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:46.322612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b307-039c-40b7-9fb3-6925e732bb6f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.322905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b307-039c-40b7-9fb3-6925e732bb6f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.323201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b307-039c-40b7-9fb3-6925e732bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.354165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-5e08b307-039c-40b7-9fb3-6925e732bb6f None None] MFA Rules not processed for user `dcb0a4a9fd1f4903a4cf5edacb06eef3`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:46.355487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5e08b307-039c-40b7-9fb3-6925e732bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:46.448370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1031/2063] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:46 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:46.449783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.544893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566b74-6c7a-4ec6-a905-edd01fb18f51 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.549818 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.550483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.550754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.551037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.551991 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.554077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.590972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1033/2064] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:46 2021] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:46.594945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b307-039c-40b7-9fb3-6925e732bb6f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.610212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b307-039c-40b7-9fb3-6925e732bb6f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.710283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.711290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.711875 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.712369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.713282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.715903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.749853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1032/2065] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:46 2021] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:46.750394 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.762841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946ee34-0d39-4f45-a822-705767e52274 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.777623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.778383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.778670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.779003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.780015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.784724 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.814196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1034/2066] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:46 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:30:46.819434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.832159 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5d57-56d8-4888-931e-776b7b4494f0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.838939 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.839609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.839888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.840166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] PATH_INFO: `/v3/projects/71e37e46967045bd81dc599428ce56d0/users/0980c85c99db4198b4f1519cf00cec98/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.858831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e37e46967045bd81dc599428ce56d0, user_id=0980c85c99db4198b4f1519cf00cec98, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.862459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:46.886254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.886723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1033/2067] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:46 2021] PUT /identity/v3/projects/71e37e46967045bd81dc599428ce56d0/users/0980c85c99db4198b4f1519cf00cec98/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:46.900074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e5d0-929a-4233-bbd8-8393110f11fd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:46.969719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:46.971851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:46.984148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:46.984996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:46.985279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:46.985554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:46.987460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:46.991554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:47.026095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1035/2068] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:46 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:47.027065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:47.043206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d435-e55b-4318-aab3-b5e1e3983bd0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:47.050765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340b2aa-6693-454f-bc8d-12bb921d5b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:47.051801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340b2aa-6693-454f-bc8d-12bb921d5b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:47.052147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340b2aa-6693-454f-bc8d-12bb921d5b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:47.053070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340b2aa-6693-454f-bc8d-12bb921d5b8d admin admin] PATH_INFO: `/v3/projects/71e37e46967045bd81dc599428ce56d0/users/0980c85c99db4198b4f1519cf00cec98/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:47.056125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340b2aa-6693-454f-bc8d-12bb921d5b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e37e46967045bd81dc599428ce56d0, user_id=0980c85c99db4198b4f1519cf00cec98, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:47.059397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340b2aa-6693-454f-bc8d-12bb921d5b8d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:47.077249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1036/2069] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:47 2021] PUT /identity/v3/projects/71e37e46967045bd81dc599428ce56d0/users/0980c85c99db4198b4f1519cf00cec98/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:47.085871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dabd20-d602-408e-abff-40c4607d200c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:47.087677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:47.087965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:47.093288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:47.139020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] MFA Rules not processed for user `0980c85c99db4198b4f1519cf00cec98`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:47.142016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:47.171746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:47.171746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:47.171746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:47.171746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] PATH_INFO: `/v3/users/bbba31cf278346d2b1ee3180a729dba2` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:47.172543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbba31cf278346d2b1ee3180a729dba2)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:47.172543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:47.268058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbba31cf278346d2b1ee3180a729dba2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:47.295854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbba31cf278346d2b1ee3180a729dba2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:47.299795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1037/2070] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:47 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:47.313701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:47.315172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbba31cf278346d2b1ee3180a729dba2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:47.316514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbba31cf278346d2b1ee3180a729dba2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:47.322812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:47.329746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2a55e909-99b6-49fe-8049-7916aa519a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbba31cf278346d2b1ee3180a729dba2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:47.345305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1034/2071] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:30:46 2021] DELETE /identity/v3/users/bbba31cf278346d2b1ee3180a729dba2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:47.357585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:47.358273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:47.359942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:47.400713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:47.401968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:47.404467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272af21-1047-4397-97dc-2f0c87a5d42b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:47.476677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:47.477269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:47.477652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:47.477934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:47.481037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:47.544570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1035/2072] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:47.576060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:47.577059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:47.580561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:47.584888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:47.609244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1038/2073] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:47 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:47.705035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c6677-f51f-4d08-9b93-bcd58d6c8c25 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:47.715593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33939f-36d7-439f-aaa9-0edd5a745eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:47.716526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33939f-36d7-439f-aaa9-0edd5a745eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:47.716961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33939f-36d7-439f-aaa9-0edd5a745eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:47.717402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33939f-36d7-439f-aaa9-0edd5a745eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:47.729321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33939f-36d7-439f-aaa9-0edd5a745eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:47.731581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33939f-36d7-439f-aaa9-0edd5a745eb3 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:47.743582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1036/2074] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:30:48.386406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:48.388160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:48.414294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a379d-07b6-41bf-9194-bb67be42ea22 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:48.419894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:48.420772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.421053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.421483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] PATH_INFO: `/v3/projects/7e5d64c304a04c25bc0ba0a948d46887` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.422677 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5d64c304a04c25bc0ba0a948d46887)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:48.424640 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:48.484623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5d64c304a04c25bc0ba0a948d46887', 'request_id': 'req-e063b175-f2e6-4151-b37e-95e23795ff9c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:48.491331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5d64c304a04c25bc0ba0a948d46887', 'request_id': 'req-e063b175-f2e6-4151-b37e-95e23795ff9c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:48.497587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5d64c304a04c25bc0ba0a948d46887', 'request_id': 'req-e063b175-f2e6-4151-b37e-95e23795ff9c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:48.512432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] The token cache is being invalidate because project 7e5d64c304a04c25bc0ba0a948d46887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:30:48.512809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:48.513445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e063b175-f2e6-4151-b37e-95e23795ff9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:30:48.515785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1039/2075] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:30:48 2021] DELETE /identity/v3/projects/7e5d64c304a04c25bc0ba0a948d46887 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:48.523041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7744a-2b1f-4c12-ba4f-6de8f0e820b4 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.523916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7744a-2b1f-4c12-ba4f-6de8f0e820b4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.524189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7744a-2b1f-4c12-ba4f-6de8f0e820b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.545089 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d5e7744a-2b1f-4c12-ba4f-6de8f0e820b4 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:48.546230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d5e7744a-2b1f-4c12-ba4f-6de8f0e820b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:48.649806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1037/2076] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:48.660550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e1df-423a-4ff6-8d1b-51cbe15da7c0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.660993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e1df-423a-4ff6-8d1b-51cbe15da7c0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.661304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e1df-423a-4ff6-8d1b-51cbe15da7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.685174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-81d8e1df-423a-4ff6-8d1b-51cbe15da7c0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:48.687627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-81d8e1df-423a-4ff6-8d1b-51cbe15da7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:48.697422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1040/2077] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:48.702653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7744a-2b1f-4c12-ba4f-6de8f0e820b4 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:48.715227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7744a-2b1f-4c12-ba4f-6de8f0e820b4 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:48.720363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:48.721199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.721503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.721742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.722489 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:30:48.722791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:48.724999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:48.737932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1038/2078] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:30:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:30:48.743056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e1df-423a-4ff6-8d1b-51cbe15da7c0 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:48.752446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e1df-423a-4ff6-8d1b-51cbe15da7c0 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:48.757645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:48.758323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.758628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.758872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.759631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:48.761572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:48.794392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1041/2079] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:48 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:48.795859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:48.806778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8279e36-34e8-4944-a117-56b9fe68ce65 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:48.865345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:48.866019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.866357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.866604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.867480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:48.869404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:48.892876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1039/2080] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:48 2021] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:48.897026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:48.911655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd36d8a-aba5-4482-8041-ecefb6a834ce admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:48.917119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:48.917788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.918063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.918337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.919068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:48.920709 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:48.937278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1042/2081] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:48 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:48.938561 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:48.951625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05886-1ad9-4047-a948-1e68c3a80d96 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:48.960141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfd617-8fe8-4fd7-bb5e-a606628fed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:48.960829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd617-8fe8-4fd7-bb5e-a606628fed80 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.961112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd617-8fe8-4fd7-bb5e-a606628fed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.961961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfd617-8fe8-4fd7-bb5e-a606628fed80 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:48.962708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd617-8fe8-4fd7-bb5e-a606628fed80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:48.964374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfd617-8fe8-4fd7-bb5e-a606628fed80 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:48.976249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1040/2082] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:48 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:48.980570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:48.991061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c800bc-9116-493a-93d0-37d9cac35f60 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:48.996510 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:48.997500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:48.997743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:48.998014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] PATH_INFO: `/v3/projects/90c43de7a6384b82b35f14a762da5d37/users/e7811e8849c74b2b9aa9182bec90fc7d/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:49.015005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c43de7a6384b82b35f14a762da5d37, user_id=e7811e8849c74b2b9aa9182bec90fc7d, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:49.017825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:49.033116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1043/2083] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:48 2021] PUT /identity/v3/projects/90c43de7a6384b82b35f14a762da5d37/users/e7811e8849c74b2b9aa9182bec90fc7d/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:30:49.038198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a764d-8c39-4733-9b85-027e91a6ed50 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:49.038473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a764d-8c39-4733-9b85-027e91a6ed50 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:49.038749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a764d-8c39-4733-9b85-027e91a6ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:49.061085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-af3a764d-8c39-4733-9b85-027e91a6ed50 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:49.063394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-af3a764d-8c39-4733-9b85-027e91a6ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:49.147012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1041/2084] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:30:49.157276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:49.159005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:49.224273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b9a0e-39f2-43d3-8126-450c70d28ecd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:49.229918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062138e9-ede3-440a-8489-0d9693999bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:49.230579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062138e9-ede3-440a-8489-0d9693999bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:49.231115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062138e9-ede3-440a-8489-0d9693999bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:49.231426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062138e9-ede3-440a-8489-0d9693999bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:49.243471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062138e9-ede3-440a-8489-0d9693999bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:49.245203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062138e9-ede3-440a-8489-0d9693999bb6 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:49.275441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1044/2085] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:53.395471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:53.396064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:53.396064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:53.424918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] MFA Rules not processed for user `81d8642de4a64b80b0a85d69663e2f91`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:53.426332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:53.501954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1042/2086] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:53 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:53.511955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab1c1-ca73-4d42-8448-dd5e87be8a21 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:53.512562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab1c1-ca73-4d42-8448-dd5e87be8a21 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:53.512562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ab1c1-ca73-4d42-8448-dd5e87be8a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:53.530110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-4f4ab1c1-ca73-4d42-8448-dd5e87be8a21 None None] MFA Rules not processed for user `81d8642de4a64b80b0a85d69663e2f91`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:53.531334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4f4ab1c1-ca73-4d42-8448-dd5e87be8a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:53.539422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1045/2087] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:53 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:54.086655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:54.088006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:54.245630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d76e59-8026-4505-a4f8-7a227e9b5435 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:54.255136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232acc6b-919e-4dbf-8fe4-ca947a166937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:54.256276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232acc6b-919e-4dbf-8fe4-ca947a166937 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:54.256816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232acc6b-919e-4dbf-8fe4-ca947a166937 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:54.257317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232acc6b-919e-4dbf-8fe4-ca947a166937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:54.271841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232acc6b-919e-4dbf-8fe4-ca947a166937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:54.283548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232acc6b-919e-4dbf-8fe4-ca947a166937 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:54.333826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1043/2088] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:54 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:30:55.345749 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37c5ab-2b34-4643-881e-31fdd096a509 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:55.346664 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37c5ab-2b34-4643-881e-31fdd096a509 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:55.347209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37c5ab-2b34-4643-881e-31fdd096a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:55.410181 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1b37c5ab-2b34-4643-881e-31fdd096a509 None None] MFA Rules not processed for user `81d8642de4a64b80b0a85d69663e2f91`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:55.416204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1b37c5ab-2b34-4643-881e-31fdd096a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:55.443198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1046/2089] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:55 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:56.021452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793ae1c-fba0-4a35-8efb-c15b714782bf None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:56.022631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793ae1c-fba0-4a35-8efb-c15b714782bf None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:56.023057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793ae1c-fba0-4a35-8efb-c15b714782bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:56.071952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0793ae1c-fba0-4a35-8efb-c15b714782bf None None] MFA Rules not processed for user `e7811e8849c74b2b9aa9182bec90fc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:30:56.073924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0793ae1c-fba0-4a35-8efb-c15b714782bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:56.174344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1044/2090] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:30:56 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:30:56.179828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37c5ab-2b34-4643-881e-31fdd096a509 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:56.195174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37c5ab-2b34-4643-881e-31fdd096a509 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:56.203810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:56.204808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:56.205309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:56.205781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:56.207556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:56.214096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:56.266460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1047/2091] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:30:56 2021] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:30:56.273201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793ae1c-fba0-4a35-8efb-c15b714782bf None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:56.301674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793ae1c-fba0-4a35-8efb-c15b714782bf None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:56.398253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:56.401280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:56.401637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:56.401984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:56.402971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:56.405608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:56.440113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1045/2092] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:30:56 2021] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:30:56.444828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:56.463793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637bc7-9816-40f9-be3c-ae41324a3359 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:56.484043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:56.484728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:56.485011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:56.485278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:56.486172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:56.493115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:56.517504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1048/2093] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:56.521919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:56.542506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5a376-740a-4fec-94bc-563b163446c1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:56.550757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:56.551851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:56.552137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:56.552414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] PATH_INFO: `/v3/projects/ac8805c0009843f799c44fc1f675cb23/users/0c97d67925b84f96884ea310ae5f5689/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:56.578805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8805c0009843f799c44fc1f675cb23, user_id=0c97d67925b84f96884ea310ae5f5689, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:56.581509 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:56.607046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1046/2094] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:56 2021] PUT /identity/v3/projects/ac8805c0009843f799c44fc1f675cb23/users/0c97d67925b84f96884ea310ae5f5689/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:56.610970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:56.634372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e1d6-acea-4388-822d-acb41cd0d9f2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:56.765088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:56.773470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:56.781092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:56.786153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:56.787066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:56.788137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:56.791512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:56.795173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:56.811559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1049/2095] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:30:56 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:30:56.816480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:30:56.832008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb224e9-cadf-4217-8e7b-096a47602881 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:56.839642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dcd58-87ac-4662-b425-dac73a4334e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:56.842261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcd58-87ac-4662-b425-dac73a4334e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:56.843409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcd58-87ac-4662-b425-dac73a4334e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:56.844876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcd58-87ac-4662-b425-dac73a4334e8 admin admin] PATH_INFO: `/v3/projects/ac8805c0009843f799c44fc1f675cb23/users/0c97d67925b84f96884ea310ae5f5689/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:56.849179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dcd58-87ac-4662-b425-dac73a4334e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8805c0009843f799c44fc1f675cb23, user_id=0c97d67925b84f96884ea310ae5f5689, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:56.853311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dcd58-87ac-4662-b425-dac73a4334e8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:56.885169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1050/2096] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:30:56 2021] PUT /identity/v3/projects/ac8805c0009843f799c44fc1f675cb23/users/0c97d67925b84f96884ea310ae5f5689/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:30:56.952267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508950e-6639-4b8a-bc5a-181b980c69be admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:30:57.093201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:30:57.093950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:30:57.094144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:30:57.094420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:30:57.106601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:30:57.245255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:30:57.247342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:30:57.265045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1047/2097] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:30:56 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:31:04.547539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810ffc-fe5b-4100-b8f5-5507925574a4 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:04.548151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810ffc-fe5b-4100-b8f5-5507925574a4 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:04.548151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26810ffc-fe5b-4100-b8f5-5507925574a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:04.583784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-26810ffc-fe5b-4100-b8f5-5507925574a4 None None] MFA Rules not processed for user `0c97d67925b84f96884ea310ae5f5689`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:04.585021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-26810ffc-fe5b-4100-b8f5-5507925574a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:04.660173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1051/2098] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:04 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:06.886485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:06.888031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:07.010860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae23c-d827-437b-973a-1ee5d8021a57 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:07.017411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e0cc-d509-4df2-8115-b4a132425f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:07.018170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e0cc-d509-4df2-8115-b4a132425f93 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:07.018542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e0cc-d509-4df2-8115-b4a132425f93 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:07.018885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e0cc-d509-4df2-8115-b4a132425f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:07.130398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e0cc-d509-4df2-8115-b4a132425f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:07.132090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e0cc-d509-4df2-8115-b4a132425f93 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:07.151712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1048/2099] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:06 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:31:08.170380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:08.171387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:08.171865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:08.224835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] MFA Rules not processed for user `b0959c5e5b1c49a9b5395f90360ce934`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:08.226133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:08.306911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1052/2100] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:31:08.859444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc602dd-7aa5-4886-b288-aa67f5703a32 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:08.859930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc602dd-7aa5-4886-b288-aa67f5703a32 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:08.860131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc602dd-7aa5-4886-b288-aa67f5703a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:08.879691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1fc602dd-7aa5-4886-b288-aa67f5703a32 None None] MFA Rules not processed for user `e7811e8849c74b2b9aa9182bec90fc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:08.880924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1fc602dd-7aa5-4886-b288-aa67f5703a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:08.889167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1049/2101] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:08 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:09.451373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:09.453052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:09.539687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33a49-15e9-4593-a19e-ba3306e9dbe9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:09.552848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:09.554533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:09.554968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:09.555546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] PATH_INFO: `/v3/users/dcb0a4a9fd1f4903a4cf5edacb06eef3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:09.557268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb0a4a9fd1f4903a4cf5edacb06eef3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:09.559590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:09.617927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb0a4a9fd1f4903a4cf5edacb06eef3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:09.625156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb0a4a9fd1f4903a4cf5edacb06eef3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:09.625893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb0a4a9fd1f4903a4cf5edacb06eef3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:09.639756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb0a4a9fd1f4903a4cf5edacb06eef3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:09.640764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb0a4a9fd1f4903a4cf5edacb06eef3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:09.664397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1053/2102] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:31:09 2021] DELETE /identity/v3/users/dcb0a4a9fd1f4903a4cf5edacb06eef3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:31:09.669001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:09.669606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:09.670080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:09.697394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:09.711137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:09.814623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1050/2103] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:31:09.822670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:09.824198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:09.915657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fdb9d-704c-473b-99b2-1ce85faf5b84 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:09.921522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:09.926083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:09.926413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:09.927482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:09.938240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:09.939807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:09.951321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1054/2104] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:31:10.290715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:10.292289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:10.311004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f7bf0-c98e-45e6-ab97-94220a6701d7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:10.334240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:10.335630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:10.336174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:10.336624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] PATH_INFO: `/v3/projects/6b44aae288424ddd905fcc6f752411cc` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:10.339012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b44aae288424ddd905fcc6f752411cc)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:10.341199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:10.404655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b44aae288424ddd905fcc6f752411cc', 'request_id': 'req-92150ff5-2596-4aa2-8657-fd7060af3abd'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.411853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b44aae288424ddd905fcc6f752411cc', 'request_id': 'req-92150ff5-2596-4aa2-8657-fd7060af3abd'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.421274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b44aae288424ddd905fcc6f752411cc', 'request_id': 'req-92150ff5-2596-4aa2-8657-fd7060af3abd'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.434515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] The token cache is being invalidate because project 6b44aae288424ddd905fcc6f752411cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:31:10.435182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.435879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.440704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1051/2105] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:31:10 2021] DELETE /identity/v3/projects/6b44aae288424ddd905fcc6f752411cc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:10.443269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:10.460754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792915-e05d-43b3-b152-1f708c7416d2 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:10.529431 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:10.530324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:10.530601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:10.530874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] PATH_INFO: `/v3/users/0980c85c99db4198b4f1519cf00cec98` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:10.532676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0980c85c99db4198b4f1519cf00cec98)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:10.535280 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:10.595729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0980c85c99db4198b4f1519cf00cec98'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.603709 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0980c85c99db4198b4f1519cf00cec98'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.604448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0980c85c99db4198b4f1519cf00cec98'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.616495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0980c85c99db4198b4f1519cf00cec98'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.617223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bf6bf013-49e0-40d0-b604-292093891893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0980c85c99db4198b4f1519cf00cec98'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:10.636733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1055/2106] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:31:10 2021] DELETE /identity/v3/users/0980c85c99db4198b4f1519cf00cec98 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:11.040916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:11.042363 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:11.058274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150ff5-2596-4aa2-8657-fd7060af3abd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:11.144459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:11.145520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.146070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.146551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] PATH_INFO: `/v3/projects/71e37e46967045bd81dc599428ce56d0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.149623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e37e46967045bd81dc599428ce56d0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:11.152891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:11.228705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e37e46967045bd81dc599428ce56d0', 'request_id': 'req-cc52851e-6e5f-4cc6-a181-129814739889'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:11.235222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e37e46967045bd81dc599428ce56d0', 'request_id': 'req-cc52851e-6e5f-4cc6-a181-129814739889'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:11.247931 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e37e46967045bd81dc599428ce56d0', 'request_id': 'req-cc52851e-6e5f-4cc6-a181-129814739889'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:11.260870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] The token cache is being invalidate because project 71e37e46967045bd81dc599428ce56d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:31:11.261537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:11.262375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-cc52851e-6e5f-4cc6-a181-129814739889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:11.264206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1052/2107] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:31:11 2021] DELETE /identity/v3/projects/71e37e46967045bd81dc599428ce56d0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:11.271539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ade3-5835-47d9-8823-2f6595a92a53 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.271832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ade3-5835-47d9-8823-2f6595a92a53 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.272104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ade3-5835-47d9-8823-2f6595a92a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.294038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5d92ade3-5835-47d9-8823-2f6595a92a53 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:11.295588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5d92ade3-5835-47d9-8823-2f6595a92a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:11.400214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1056/2108] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:31:11.409712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7d18-35a6-44b7-83ad-c2d4455dd0b4 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.410278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7d18-35a6-44b7-83ad-c2d4455dd0b4 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.410278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7d18-35a6-44b7-83ad-c2d4455dd0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.440073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-fa2e7d18-35a6-44b7-83ad-c2d4455dd0b4 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:11.441361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fa2e7d18-35a6-44b7-83ad-c2d4455dd0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:11.453484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1053/2109] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:11.459669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92ade3-5835-47d9-8823-2f6595a92a53 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:11.470358 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92ade3-5835-47d9-8823-2f6595a92a53 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:11.481305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:11.482284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.482711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.483274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.484335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:31:11.484714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:11.486987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:11.504517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1057/2110] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:31:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:31:11.509638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7d18-35a6-44b7-83ad-c2d4455dd0b4 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:11.522455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7d18-35a6-44b7-83ad-c2d4455dd0b4 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:11.532125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:11.532907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.533414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.534035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.534928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:11.538291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:11.575484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1054/2111] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:31:11 2021] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:31:11.579676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:11.591034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49808bb-c270-4369-8223-691df971a5da admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:11.668992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:11.669744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.670026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.670302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.671367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:11.673246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:11.701660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1058/2112] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:31:11 2021] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:31:11.706488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:11.717499 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bca55c-76ee-485f-b0e5-001ee93e8b3a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:11.722600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:11.723317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.723633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.724076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.724789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:11.726433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:11.737625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1055/2113] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:31:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:31:11.741697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:11.755686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feb909-3352-4679-a299-48efccdeb327 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:11.768240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de8122-2148-42c6-baab-5e0c347ed2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:11.770269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de8122-2148-42c6-baab-5e0c347ed2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.770269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de8122-2148-42c6-baab-5e0c347ed2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.770269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de8122-2148-42c6-baab-5e0c347ed2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.771196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de8122-2148-42c6-baab-5e0c347ed2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:11.776018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de8122-2148-42c6-baab-5e0c347ed2c2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:11.797279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1059/2114] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:31:11 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:31:11.797907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:11.809787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c40e9a-0a93-476d-8736-adf7b5a4d4bd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:11.815820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:11.817176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.817680 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.818053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] PATH_INFO: `/v3/projects/8020119b67094f7bac557af1e97cfe99/users/834659f41a8f40199ac614620e341c68/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.836662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8020119b67094f7bac557af1e97cfe99, user_id=834659f41a8f40199ac614620e341c68, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:11.842330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:11.865009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1056/2115] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:31:11 2021] PUT /identity/v3/projects/8020119b67094f7bac557af1e97cfe99/users/834659f41a8f40199ac614620e341c68/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:11.875570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816190-d68e-44f1-a1fd-befa35e85a29 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:11.875804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816190-d68e-44f1-a1fd-befa35e85a29 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:11.876082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816190-d68e-44f1-a1fd-befa35e85a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:11.912081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f5816190-d68e-44f1-a1fd-befa35e85a29 None None] MFA Rules not processed for user `834659f41a8f40199ac614620e341c68`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:11.913255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f5816190-d68e-44f1-a1fd-befa35e85a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:11.988132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1060/2116] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:11 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:11.999395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:12.001560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.095242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa4e3-8eac-4f7e-a2cb-738abea90208 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:12.099168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:12.099862 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.100141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.100412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.110849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:12.112470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:12.125522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1057/2117] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:11 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:31:12.144796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816190-d68e-44f1-a1fd-befa35e85a29 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:12.204873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:12.207768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.237327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816190-d68e-44f1-a1fd-befa35e85a29 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:12.243606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:12.244579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.244874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.245287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] PATH_INFO: `/v3/users/834659f41a8f40199ac614620e341c68` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.246981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=834659f41a8f40199ac614620e341c68)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:12.249255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:12.286104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d62de-198e-4630-adab-57489605c04c service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:12.291470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:12.292380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.292661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.292925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] PATH_INFO: `/v3/users/c62d643d4c824ee8bfffba1a177f48ce` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.294253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62d643d4c824ee8bfffba1a177f48ce)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:12.296211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:12.303127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834659f41a8f40199ac614620e341c68'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.311547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834659f41a8f40199ac614620e341c68'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.313258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834659f41a8f40199ac614620e341c68'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.330611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834659f41a8f40199ac614620e341c68'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.331680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-ce6c86d0-04a4-49be-b391-877e17cbcb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834659f41a8f40199ac614620e341c68'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.347631 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1061/2118] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:31:12 2021] DELETE /identity/v3/users/834659f41a8f40199ac614620e341c68 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:12.352306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.352657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.353144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.374183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62d643d4c824ee8bfffba1a177f48ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.376052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:12.377288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.386541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62d643d4c824ee8bfffba1a177f48ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.394583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62d643d4c824ee8bfffba1a177f48ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.400977 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62d643d4c824ee8bfffba1a177f48ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.414894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-f4417554-948d-409e-a215-02495784fc10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62d643d4c824ee8bfffba1a177f48ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.430677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1058/2119] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:31:12 2021] DELETE /identity/v3/users/c62d643d4c824ee8bfffba1a177f48ce => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:12.433750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.434726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.435494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.459733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1062/2120] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:12.461292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:12.462813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.465723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:12.469542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.546422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1059/2121] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:31:12.547688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:12.549496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.564041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d8199-54f0-4f7d-bfd0-144907027310 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:12.565219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f448e7-6a0e-42ff-a53c-58339e4a79ea None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:12.586206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:12.587427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.591343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.592391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] PATH_INFO: `/v3/users/5c60cdebf66741eab0c8cd28319f8088` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.602763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c60cdebf66741eab0c8cd28319f8088)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:12.604807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:12.627488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:12.628426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.628860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.629856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.643213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:12.649229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:12.671091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1063/2122] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:31:12.678278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:12.693101 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c60cdebf66741eab0c8cd28319f8088'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.701388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024a33a-611c-4f70-b067-06eb74d9887d service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:12.712261 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c60cdebf66741eab0c8cd28319f8088'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.721630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:12.723027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.723516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.723942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.726892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c60cdebf66741eab0c8cd28319f8088'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.728281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c60cdebf66741eab0c8cd28319f8088'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.741329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6f4fb459-ac7f-4175-8df7-ddaf5477e620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c60cdebf66741eab0c8cd28319f8088'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:12.741950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:12.743659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:12.748788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1060/2123] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:31:12 2021] DELETE /identity/v3/users/5c60cdebf66741eab0c8cd28319f8088 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:12.758009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.758200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1064/2124] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:31:12.758757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.759134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.778209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:12.779618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.857129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1061/2125] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:31:12.873972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:12.875690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:12.890733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaeadc-2659-48e0-9863-f496eb78aa3f service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:12.981699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:12.982558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:12.982834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:12.983112 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:12.994313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:12.996106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:13.007825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1065/2126] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:31:13.258346 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:13.260357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:13.301361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd966d7-eda1-48e8-81e3-5732e7acbd21 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:13.307171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:13.308457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.308737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.309002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] PATH_INFO: `/v3/projects/2cd8469837974206a864b7a482bc6e21` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.310445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd8469837974206a864b7a482bc6e21)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:13.312518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:13.362454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:13.363972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:13.382375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd8469837974206a864b7a482bc6e21', 'request_id': 'req-27949864-672b-4047-9ae3-fe9ebecb7a4b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.389442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd8469837974206a864b7a482bc6e21', 'request_id': 'req-27949864-672b-4047-9ae3-fe9ebecb7a4b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.398427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02443d8-b5d9-439e-a451-02b14ac994d1 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:13.399522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd8469837974206a864b7a482bc6e21', 'request_id': 'req-27949864-672b-4047-9ae3-fe9ebecb7a4b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.415208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] The token cache is being invalidate because project 2cd8469837974206a864b7a482bc6e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:31:13.415828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.417186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-27949864-672b-4047-9ae3-fe9ebecb7a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.419696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1062/2127] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:31:13 2021] DELETE /identity/v3/projects/2cd8469837974206a864b7a482bc6e21 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:13.425456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00360b98-fdf5-452f-9b90-be533ec91545 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.425966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00360b98-fdf5-452f-9b90-be533ec91545 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.426497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00360b98-fdf5-452f-9b90-be533ec91545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.470819 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-00360b98-fdf5-452f-9b90-be533ec91545 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:13.472117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-00360b98-fdf5-452f-9b90-be533ec91545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:13.493102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:13.494534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.494770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.495154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] PATH_INFO: `/v3/projects/8020119b67094f7bac557af1e97cfe99` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.496571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8020119b67094f7bac557af1e97cfe99)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:13.498755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:13.547339 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1063/2128] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:13.548100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8020119b67094f7bac557af1e97cfe99', 'request_id': 'req-0498f409-eee9-4db7-b873-71c360a118b1'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.549538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e87c-17de-4aa4-b362-16cab737966d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.549829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e87c-17de-4aa4-b362-16cab737966d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.550471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e87c-17de-4aa4-b362-16cab737966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.559102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8020119b67094f7bac557af1e97cfe99', 'request_id': 'req-0498f409-eee9-4db7-b873-71c360a118b1'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.564788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8020119b67094f7bac557af1e97cfe99', 'request_id': 'req-0498f409-eee9-4db7-b873-71c360a118b1'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.571565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3922e87c-17de-4aa4-b362-16cab737966d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:13.573096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3922e87c-17de-4aa4-b362-16cab737966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:13.590265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] The token cache is being invalidate because project 8020119b67094f7bac557af1e97cfe99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:31:13.590555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.591428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.593759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1066/2129] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:31:13 2021] DELETE /identity/v3/projects/8020119b67094f7bac557af1e97cfe99 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:13.672110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:13.678340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:13.685117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1064/2130] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:13.694714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922e87c-17de-4aa4-b362-16cab737966d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:13.707446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922e87c-17de-4aa4-b362-16cab737966d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:13.719226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498f409-eee9-4db7-b873-71c360a118b1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:13.725153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:13.725601 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:13.726206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.726976 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.727109 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.727485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.727705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.727953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] PATH_INFO: `/v3/projects/b6fd4f3836f140c0a1e3173abaad0f95` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.728922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:31:13.729404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:13.729853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6fd4f3836f140c0a1e3173abaad0f95)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:13.731664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:13.732439 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:13.747487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1065/2131] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:31:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:31:13.751691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:13.770144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63349c04-ab45-4019-a097-4910e34ac136 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:13.777479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:13.778161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.778451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.778746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.779607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:13.781959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:13.800386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6fd4f3836f140c0a1e3173abaad0f95', 'request_id': 'req-731b301c-8130-4189-84a4-d4f20a9ff099'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.808884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6fd4f3836f140c0a1e3173abaad0f95', 'request_id': 'req-731b301c-8130-4189-84a4-d4f20a9ff099'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.819016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1066/2132] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:31:13 2021] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:31:13.820189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6fd4f3836f140c0a1e3173abaad0f95', 'request_id': 'req-731b301c-8130-4189-84a4-d4f20a9ff099'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.825243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:13.836143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] The token cache is being invalidate because project b6fd4f3836f140c0a1e3173abaad0f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:31:13.836963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.837126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:31:13.839202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1067/2133] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:31:13 2021] DELETE /identity/v3/projects/b6fd4f3836f140c0a1e3173abaad0f95 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:31:13.903816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c5a67-7611-4664-af2f-d50c4ac3f1dc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:13.909511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:13.910677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:13.910967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:13.911243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:13.912214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:13.914409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:13.941072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1067/2134] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:31:13 2021] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:31:13.946091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:13.947640 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:14.031683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b301c-8130-4189-84a4-d4f20a9ff099 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:14.037134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:14.037808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:14.038085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:14.038354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:14.039115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:14.040821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:14.052228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1068/2135] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:31:13 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:31:14.056533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:14.066500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477436eb-5a79-4173-b20d-1df3eb2dbe19 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:14.071422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91442f-4cf3-4bcd-9063-bf20debd4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:14.072096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91442f-4cf3-4bcd-9063-bf20debd4dfc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:14.072373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91442f-4cf3-4bcd-9063-bf20debd4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:14.072643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91442f-4cf3-4bcd-9063-bf20debd4dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:14.073393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91442f-4cf3-4bcd-9063-bf20debd4dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:14.075117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91442f-4cf3-4bcd-9063-bf20debd4dfc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:14.089777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1068/2136] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:31:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:31:14.091339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:14.101504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930477c-6f71-4bc8-90a4-0bddad0da7d6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:14.106161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:14.107050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:14.107326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:14.107636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] PATH_INFO: `/v3/projects/7dd6a8224c1149f6a978d9174fa5a7ee/users/6faa1a83294641068232fe1b173af45e/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:14.121919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd6a8224c1149f6a978d9174fa5a7ee, user_id=6faa1a83294641068232fe1b173af45e, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:14.124598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:14.138417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1069/2137] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:31:14 2021] PUT /identity/v3/projects/7dd6a8224c1149f6a978d9174fa5a7ee/users/6faa1a83294641068232fe1b173af45e/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:31:14.143905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1686dd-2264-44bd-898b-3918da79c796 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:14.144195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1686dd-2264-44bd-898b-3918da79c796 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:14.144465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1686dd-2264-44bd-898b-3918da79c796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:14.162139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-6a1686dd-2264-44bd-898b-3918da79c796 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:14.163371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6a1686dd-2264-44bd-898b-3918da79c796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:14.227596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1069/2138] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:31:14.237584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:14.239895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:14.302783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628425c1-3cb5-4b37-8624-e237afb68ad8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:14.307205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:14.308027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:14.308298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:14.308755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:14.320139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:14.321651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:14.333774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1070/2139] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:31:15.014770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133fe9-f41e-4c38-956e-5eb1880471e1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:15.015249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133fe9-f41e-4c38-956e-5eb1880471e1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:15.015330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133fe9-f41e-4c38-956e-5eb1880471e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:15.043757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a6133fe9-f41e-4c38-956e-5eb1880471e1 None None] MFA Rules not processed for user `6faa1a83294641068232fe1b173af45e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:15.045051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a6133fe9-f41e-4c38-956e-5eb1880471e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:15.118405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1070/2140] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:15 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:15.128891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:15.131276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:15.200860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d04fe3-7ffe-41bd-9ad5-ca26422752bb service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:15.204639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7d16e-8df4-4325-8507-90f0de42dfa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:15.205400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d16e-8df4-4325-8507-90f0de42dfa4 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:15.205679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d16e-8df4-4325-8507-90f0de42dfa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:15.206094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d16e-8df4-4325-8507-90f0de42dfa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:15.215219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7d16e-8df4-4325-8507-90f0de42dfa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:15.216841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7d16e-8df4-4325-8507-90f0de42dfa4 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:15.228620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1071/2141] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:15 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:31:16.627856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88daf-97a1-4a9a-91e2-ee45c2092b73 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:16.628527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88daf-97a1-4a9a-91e2-ee45c2092b73 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:16.628527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88daf-97a1-4a9a-91e2-ee45c2092b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:16.648064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f8f88daf-97a1-4a9a-91e2-ee45c2092b73 None None] MFA Rules not processed for user `6faa1a83294641068232fe1b173af45e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:16.649196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f8f88daf-97a1-4a9a-91e2-ee45c2092b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:16.658173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1071/2142] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:16 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:33.605822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f181b-fb1c-4259-b3bb-ee5781cce693 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:33.606397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f181b-fb1c-4259-b3bb-ee5781cce693 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:33.606397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f181b-fb1c-4259-b3bb-ee5781cce693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:33.624058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-823f181b-fb1c-4259-b3bb-ee5781cce693 None None] MFA Rules not processed for user `b0959c5e5b1c49a9b5395f90360ce934`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:31:33.625546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-823f181b-fb1c-4259-b3bb-ee5781cce693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:33.690838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1072/2143] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:31:33 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:31:54.746022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f88daf-97a1-4a9a-91e2-ee45c2092b73 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:31:54.786448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f88daf-97a1-4a9a-91e2-ee45c2092b73 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:31:54.790444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:31:54.791104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:31:54.791444 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:31:54.791730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:31:54.793747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:31:54.889215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:31:54.890743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:31:54.901171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1072/2144] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:31:54 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:32:01.206559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:01.207057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:01.207142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:01.227682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:32:01.229120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:01.291813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1073/2145] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:32:01 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:32:01.346026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:32:01.348686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:01.424993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25ace-a56c-446c-90ff-1561aedcf482 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:32:01.430547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe945d59-92fa-4436-8034-17cc730a8392 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:32:01.431191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe945d59-92fa-4436-8034-17cc730a8392 service swift] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:01.431504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe945d59-92fa-4436-8034-17cc730a8392 service swift] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:01.431773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe945d59-92fa-4436-8034-17cc730a8392 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:01.441032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe945d59-92fa-4436-8034-17cc730a8392 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:32:01.442624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe945d59-92fa-4436-8034-17cc730a8392 service swift] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:32:01.452019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1073/2146] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:32:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:32:22.641139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:32:22.642764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:22.746976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9e50-62ef-48a2-aadd-12d8cf50c706 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:32:22.752429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cde35-5598-4bd1-8ff0-956d97f9ecba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:32:22.753163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cde35-5598-4bd1-8ff0-956d97f9ecba service placement] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:22.753513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cde35-5598-4bd1-8ff0-956d97f9ecba service placement] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:22.754142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cde35-5598-4bd1-8ff0-956d97f9ecba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:22.756300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-505cde35-5598-4bd1-8ff0-956d97f9ecba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:22.768978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cde35-5598-4bd1-8ff0-956d97f9ecba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:32:22.770754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cde35-5598-4bd1-8ff0-956d97f9ecba service placement] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:32:22.784274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1074/2147] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:32:22 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:32:24.944247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865ed3-be6f-4ba8-89bb-9260982ea640 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:24.945157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865ed3-be6f-4ba8-89bb-9260982ea640 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:24.945578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865ed3-be6f-4ba8-89bb-9260982ea640 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:24.948621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1074/2148] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:32:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:32:24.955374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41c9ef-4c95-4816-a293-59e8fb8a8031 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:24.955905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41c9ef-4c95-4816-a293-59e8fb8a8031 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:24.955905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41c9ef-4c95-4816-a293-59e8fb8a8031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:25.057322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-3a41c9ef-4c95-4816-a293-59e8fb8a8031 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:32:25.058795 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3a41c9ef-4c95-4816-a293-59e8fb8a8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:25.165551 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1075/2149] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:32:24 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:32:25.179014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83865ed3-be6f-4ba8-89bb-9260982ea640 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:32:25.180698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-83865ed3-be6f-4ba8-89bb-9260982ea640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:25.245949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83865ed3-be6f-4ba8-89bb-9260982ea640 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:32:25.250126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce8652-beaa-4e1b-be11-64273f0099da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:32:25.250922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce8652-beaa-4e1b-be11-64273f0099da service glance] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:25.251303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce8652-beaa-4e1b-be11-64273f0099da service glance] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:25.251716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce8652-beaa-4e1b-be11-64273f0099da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:25.262593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce8652-beaa-4e1b-be11-64273f0099da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:32:25.264266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce8652-beaa-4e1b-be11-64273f0099da service glance] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:32:25.277947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1075/2150] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:32:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:32:25.357509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c830ee-a71f-497f-9991-c00e052f9b69 None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:25.357796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c830ee-a71f-497f-9991-c00e052f9b69 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:25.358205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c830ee-a71f-497f-9991-c00e052f9b69 None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:25.360157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1076/2151] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:32:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:32:25.366302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c4fae-fea9-4278-9b20-bc789f6938c3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:25.366594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c4fae-fea9-4278-9b20-bc789f6938c3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:25.366873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c4fae-fea9-4278-9b20-bc789f6938c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:25.405691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-fd7c4fae-fea9-4278-9b20-bc789f6938c3 None None] MFA Rules not processed for user `3357ca71ec4443f8a9fba9b7ac4cfdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:32:25.406931 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fd7c4fae-fea9-4278-9b20-bc789f6938c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:25.414000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1076/2152] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:32:25 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:32:25.426748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c830ee-a71f-497f-9991-c00e052f9b69 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:32:25.429069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a2c830ee-a71f-497f-9991-c00e052f9b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:25.442700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c830ee-a71f-497f-9991-c00e052f9b69 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:32:25.447088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:32:25.448010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:25.448294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:25.448569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:25.456607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:32:25.458189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:32:25.467487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1077/2153] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:32:25 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:32:29.634522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64e981-b05f-41c7-8f03-e76cbd0ae009 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:29.635036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64e981-b05f-41c7-8f03-e76cbd0ae009 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:29.635216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64e981-b05f-41c7-8f03-e76cbd0ae009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:29.658236 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-db64e981-b05f-41c7-8f03-e76cbd0ae009 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:32:29.659687 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-db64e981-b05f-41c7-8f03-e76cbd0ae009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:32:29.667807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1077/2154] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:32:29 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:32:29.683979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:32:29.696762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182ccaa-9350-4c30-9a1b-706df82f24f2 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:32:29.701915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:32:29.702567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:32:29.702838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:32:29.703111 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:32:29.715097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:32:29.716733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:32:29.725223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1078/2155] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:32:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:00.357429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b147-b985-4eca-b4d8-bead01665783 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:00.358084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b147-b985-4eca-b4d8-bead01665783 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:00.358084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b147-b985-4eca-b4d8-bead01665783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:00.376281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-7855b147-b985-4eca-b4d8-bead01665783 None None] MFA Rules not processed for user `6faa1a83294641068232fe1b173af45e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:00.377502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7855b147-b985-4eca-b4d8-bead01665783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:00.384706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1078/2156] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:00 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:04.185710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:04.188116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:04.257314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9fe0-ec1a-4111-a9c8-58c4acb5d984 service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:04.262756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:04.263667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.263947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.264219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] PATH_INFO: `/v3/users/b0959c5e5b1c49a9b5395f90360ce934` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.265421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0959c5e5b1c49a9b5395f90360ce934)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:04.267376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:04.318622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0959c5e5b1c49a9b5395f90360ce934'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.325725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0959c5e5b1c49a9b5395f90360ce934'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.326407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0959c5e5b1c49a9b5395f90360ce934'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.338021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0959c5e5b1c49a9b5395f90360ce934'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.338708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-854f69cc-2ffa-4553-bdbd-258fcf39173e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0959c5e5b1c49a9b5395f90360ce934'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.352554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1079/2157] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:33:04 2021] DELETE /identity/v3/users/b0959c5e5b1c49a9b5395f90360ce934 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:04.534897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b147-b985-4eca-b4d8-bead01665783 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:04.553721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b147-b985-4eca-b4d8-bead01665783 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:04.624729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.625494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.626186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.642185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:04.643046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.643322 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.643631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] PATH_INFO: `/v3/projects/01d740e2fdbb43f696818d258b9b3f4d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.644810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d740e2fdbb43f696818d258b9b3f4d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:04.646713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:04.678006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:04.679905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:04.696309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d740e2fdbb43f696818d258b9b3f4d', 'request_id': 'req-60ad47e0-1b2c-4e44-bf64-903495d4af6f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.703368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d740e2fdbb43f696818d258b9b3f4d', 'request_id': 'req-60ad47e0-1b2c-4e44-bf64-903495d4af6f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.714270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d740e2fdbb43f696818d258b9b3f4d', 'request_id': 'req-60ad47e0-1b2c-4e44-bf64-903495d4af6f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.726594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] The token cache is being invalidate because project 01d740e2fdbb43f696818d258b9b3f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:33:04.726970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.727950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-60ad47e0-1b2c-4e44-bf64-903495d4af6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:04.729543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1079/2158] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:33:04 2021] DELETE /identity/v3/projects/01d740e2fdbb43f696818d258b9b3f4d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:04.736070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6333-fcdd-499c-a35f-79a7c65c27fe None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.736352 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6333-fcdd-499c-a35f-79a7c65c27fe None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.736630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6333-fcdd-499c-a35f-79a7c65c27fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.749825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1080/2159] 10.222.0.58 () {58 vars in 968 bytes} [Fri Aug 27 03:33:04 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:04.774076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:04.775726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:04.790225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8f3a6333-fcdd-499c-a35f-79a7c65c27fe None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:04.791993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8f3a6333-fcdd-499c-a35f-79a7c65c27fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:04.853008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1080/2160] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:33:04.861267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1457f44-fede-44c6-a728-ea3f44c89690 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.862520 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1457f44-fede-44c6-a728-ea3f44c89690 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.863045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1457f44-fede-44c6-a728-ea3f44c89690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.871973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acec4a2-fd49-4714-a94f-e78547d61b4c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:04.877610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:04.877937 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.878215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.878488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.883671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a1457f44-fede-44c6-a728-ea3f44c89690 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:04.885431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a1457f44-fede-44c6-a728-ea3f44c89690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:04.887128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:04.888864 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:04.894534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1081/2161] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:33:04.898128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1081/2162] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:33:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 03:33:04.898818 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1457f44-fede-44c6-a728-ea3f44c89690 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:04.909203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1457f44-fede-44c6-a728-ea3f44c89690 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:04.914224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:04.914885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.915162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.915567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.916303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:33:04.916726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:04.918312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:04.931439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1082/2163] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:33:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:33:04.935223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:04.946057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442962fc-6964-4cf5-9ab5-7073aba00e68 service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:04.951476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:04.952264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:04.952605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:04.952971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:04.953745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:04.955775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:04.988445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1082/2164] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:33:04 2021] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:04.993501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.005423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55625b00-2e75-43fa-8649-0b4b33a1ded0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.080946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.081627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.082128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.082478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.083365 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.085401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.111423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1083/2165] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:33:04 2021] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:33:05.112629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.125098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5264bc1-8fe0-4960-8fe9-51d6afa101ec admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.130907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.131694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.132038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.132391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.133449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.136015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.151414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1083/2166] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:05 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:05.154347 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.165039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f20c-aacd-49ac-aa7e-68d1e646ae25 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.170022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04512e-84ee-462a-ad5d-341caf4f93e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.170718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04512e-84ee-462a-ad5d-341caf4f93e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.171045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04512e-84ee-462a-ad5d-341caf4f93e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.171545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04512e-84ee-462a-ad5d-341caf4f93e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.172294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04512e-84ee-462a-ad5d-341caf4f93e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.174216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04512e-84ee-462a-ad5d-341caf4f93e5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.186501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1084/2167] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:05.191087 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.202429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe59df0-96e0-4fe7-82ae-3c14c2f06d08 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.207534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.208478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.208751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.209233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] PATH_INFO: `/v3/projects/fc23689da5014599ac1dc7139b183791/users/7e9b952ac56d4bc68032d101375eff2c/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.231742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc23689da5014599ac1dc7139b183791, user_id=7e9b952ac56d4bc68032d101375eff2c, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.234497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.260274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1084/2168] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:05 2021] PUT /identity/v3/projects/fc23689da5014599ac1dc7139b183791/users/7e9b952ac56d4bc68032d101375eff2c/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:05.262434 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda9e7-8b57-4377-8298-5f71eb5ff895 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.262717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda9e7-8b57-4377-8298-5f71eb5ff895 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.262982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda9e7-8b57-4377-8298-5f71eb5ff895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.297102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f6eda9e7-8b57-4377-8298-5f71eb5ff895 None None] MFA Rules not processed for user `7e9b952ac56d4bc68032d101375eff2c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:05.298593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f6eda9e7-8b57-4377-8298-5f71eb5ff895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:05.377566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1085/2169] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:05 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:05.381911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.453079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44312ab2-5a77-4b74-a114-cb4fc57eaf24 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.457763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.458432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.458716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.458993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.459737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.461700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.489958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1085/2170] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:33:05 2021] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:05.494004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda9e7-8b57-4377-8298-5f71eb5ff895 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.505014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda9e7-8b57-4377-8298-5f71eb5ff895 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.571038 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.571958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.572315 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.572653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.573430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.575720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.602173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1086/2171] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:33:05 2021] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:33:05.603971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.615501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf4454-0c5e-41fb-aa23-a3ec5ebee62a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.620790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.621461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.622535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.622535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.622789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.624423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.641615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1086/2172] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:05 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:05.643228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.654940 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee607e88-143f-45f0-a4f1-200df2753715 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.659665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.660589 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.660850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.661142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] PATH_INFO: `/v3/projects/996374dfeb0f4cc682b3b899618627fa/users/24d00b237cb34e96b70a435530e1c71a/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.679283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996374dfeb0f4cc682b3b899618627fa, user_id=24d00b237cb34e96b70a435530e1c71a, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.682019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.708760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1087/2173] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:05 2021] PUT /identity/v3/projects/996374dfeb0f4cc682b3b899618627fa/users/24d00b237cb34e96b70a435530e1c71a/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:05.713390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.724469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1e29-89e9-47eb-9724-d3874b6fb219 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.783650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43f624-e0f0-4777-9142-ee812dedaac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.783872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f624-e0f0-4777-9142-ee812dedaac8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.784354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f624-e0f0-4777-9142-ee812dedaac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.784515 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f624-e0f0-4777-9142-ee812dedaac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.785761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43f624-e0f0-4777-9142-ee812dedaac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.787288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43f624-e0f0-4777-9142-ee812dedaac8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.798874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1087/2174] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:05 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:05.804693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.815633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6371d-0899-4a24-9a33-3c5be7ef30f8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:05.821073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:05.822204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.822387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.822679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] PATH_INFO: `/v3/projects/996374dfeb0f4cc682b3b899618627fa/users/24d00b237cb34e96b70a435530e1c71a/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.824797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996374dfeb0f4cc682b3b899618627fa, user_id=24d00b237cb34e96b70a435530e1c71a, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:05.827440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:05.839050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1088/2175] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:05 2021] PUT /identity/v3/projects/996374dfeb0f4cc682b3b899618627fa/users/24d00b237cb34e96b70a435530e1c71a/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:05.854216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5a49-fd0c-47a7-8632-974a2d7e1fa7 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:05.854505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5a49-fd0c-47a7-8632-974a2d7e1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:05.854783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f5a49-fd0c-47a7-8632-974a2d7e1fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:05.882538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-759f5a49-fd0c-47a7-8632-974a2d7e1fa7 None None] MFA Rules not processed for user `24d00b237cb34e96b70a435530e1c71a`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:05.883793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-759f5a49-fd0c-47a7-8632-974a2d7e1fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:05.956666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1088/2176] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:05 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:05.970213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:05.972399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:06.065043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa25d-7577-4a9c-ac9c-d9189c743791 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:06.069161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6b80-1f84-4260-89c4-9ebea622d9ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:06.069852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6b80-1f84-4260-89c4-9ebea622d9ab service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:06.070137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6b80-1f84-4260-89c4-9ebea622d9ab service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:06.070415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6b80-1f84-4260-89c4-9ebea622d9ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:06.080524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6b80-1f84-4260-89c4-9ebea622d9ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:06.081968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6b80-1f84-4260-89c4-9ebea622d9ab service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:06.094510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1089/2177] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:05 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:06.239473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f5a49-fd0c-47a7-8632-974a2d7e1fa7 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:06.304751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f5a49-fd0c-47a7-8632-974a2d7e1fa7 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:06.309808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:06.310723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:06.310989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:06.311285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] PATH_INFO: `/v3/users/7e9b952ac56d4bc68032d101375eff2c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:06.312536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9b952ac56d4bc68032d101375eff2c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:06.314461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:06.362336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9b952ac56d4bc68032d101375eff2c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.369095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9b952ac56d4bc68032d101375eff2c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.376451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9b952ac56d4bc68032d101375eff2c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.388973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9b952ac56d4bc68032d101375eff2c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.389708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9b952ac56d4bc68032d101375eff2c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.403386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1089/2178] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:33:06 2021] DELETE /identity/v3/users/7e9b952ac56d4bc68032d101375eff2c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:06.408026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:06.408316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:06.408593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:06.426418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:06.427691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:06.496324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1090/2179] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:06.506504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:06.508273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:06.567854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4930c-78ad-4f1a-b55b-6ce4a2bac96e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:06.572607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:06.573254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:06.573537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:06.573809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:06.583639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:06.585090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:06.594613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1090/2180] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:06.877460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:06.879219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:06.896213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188173fc-086a-4fa3-b36b-3a5f9f0f5c8b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:06.902616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:06.903684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:06.904067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:06.904592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] PATH_INFO: `/v3/projects/fc23689da5014599ac1dc7139b183791` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:06.906326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc23689da5014599ac1dc7139b183791)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:06.909010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:06.960078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc23689da5014599ac1dc7139b183791', 'request_id': 'req-fbf886db-f876-49bb-a0c5-e53f59196859'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.966796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc23689da5014599ac1dc7139b183791', 'request_id': 'req-fbf886db-f876-49bb-a0c5-e53f59196859'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.975607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc23689da5014599ac1dc7139b183791', 'request_id': 'req-fbf886db-f876-49bb-a0c5-e53f59196859'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.986685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] The token cache is being invalidate because project fc23689da5014599ac1dc7139b183791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:33:06.986972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.987644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:06.989189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1091/2181] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:33:06 2021] DELETE /identity/v3/projects/fc23689da5014599ac1dc7139b183791 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:06.993410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:07.003286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d27ee-5ca2-4950-bf70-5fd4b3346258 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:07.063577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:07.064575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:07.064925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:07.065284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] PATH_INFO: `/v3/users/24d00b237cb34e96b70a435530e1c71a` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:07.066589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d00b237cb34e96b70a435530e1c71a)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:07.068556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:07.117797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d00b237cb34e96b70a435530e1c71a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.125006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d00b237cb34e96b70a435530e1c71a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.125796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d00b237cb34e96b70a435530e1c71a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.137895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d00b237cb34e96b70a435530e1c71a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.138646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2bbb73fb-8253-4afc-ab6f-adbce76af717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d00b237cb34e96b70a435530e1c71a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.157690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1091/2182] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:33:06 2021] DELETE /identity/v3/users/24d00b237cb34e96b70a435530e1c71a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:07.462486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:07.464528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:07.482123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf886db-f876-49bb-a0c5-e53f59196859 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:07.541411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:07.542362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:07.542643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:07.542913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] PATH_INFO: `/v3/projects/996374dfeb0f4cc682b3b899618627fa` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:07.544096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] RBAC: Authorizing `identity:delete_project(project_id=996374dfeb0f4cc682b3b899618627fa)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:07.546019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:07.602091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996374dfeb0f4cc682b3b899618627fa', 'request_id': 'req-6994fc6d-011a-4d3b-9e66-f55db8e4259e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.608461 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996374dfeb0f4cc682b3b899618627fa', 'request_id': 'req-6994fc6d-011a-4d3b-9e66-f55db8e4259e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.618851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996374dfeb0f4cc682b3b899618627fa', 'request_id': 'req-6994fc6d-011a-4d3b-9e66-f55db8e4259e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.629271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] The token cache is being invalidate because project 996374dfeb0f4cc682b3b899618627fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:33:07.629560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.630221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6994fc6d-011a-4d3b-9e66-f55db8e4259e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:07.631876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1092/2183] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:33:07 2021] DELETE /identity/v3/projects/996374dfeb0f4cc682b3b899618627fa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:07.638308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9fef5-266e-4db3-8bcc-24f22d90611c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:07.638814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9fef5-266e-4db3-8bcc-24f22d90611c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:07.638909 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9fef5-266e-4db3-8bcc-24f22d90611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:07.657271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5bf9fef5-266e-4db3-8bcc-24f22d90611c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:07.658480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5bf9fef5-266e-4db3-8bcc-24f22d90611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:07.719031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1092/2184] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:07.727088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85846-1d7a-49ec-990d-83d0002a18f2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:07.727532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85846-1d7a-49ec-990d-83d0002a18f2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:07.728419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85846-1d7a-49ec-990d-83d0002a18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:07.747661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-43f85846-1d7a-49ec-990d-83d0002a18f2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:07.748877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-43f85846-1d7a-49ec-990d-83d0002a18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:07.757690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1093/2185] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:07.762090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9fef5-266e-4db3-8bcc-24f22d90611c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:07.772628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9fef5-266e-4db3-8bcc-24f22d90611c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:07.777670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:07.778320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:07.778597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:07.778859 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:07.779619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:33:07.779922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:07.781519 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:07.794331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1093/2186] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:33:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:33:07.799343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85846-1d7a-49ec-990d-83d0002a18f2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:07.817712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85846-1d7a-49ec-990d-83d0002a18f2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:07.827159 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:07.828252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:07.828702 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:07.829121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:07.830190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:07.833319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:07.870505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1094/2187] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:33:07 2021] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:07.874917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:07.885602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3ebb5-f10a-46c2-a029-4144c133cb16 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:07.953876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:07.954623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:07.954924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:07.955191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:07.955894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:07.957892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:07.980616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1094/2188] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:33:07 2021] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:07.984766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:07.995380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa156dc-38ee-4c8a-be03-fc4e862cc343 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.001011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.001677 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.001960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.002234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.002969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.004636 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.015267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1095/2189] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:08.019389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.031941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25843a1-6fb9-437b-9525-6863060aa3df admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.037281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8d67f-a614-471b-a648-5cc0c3ca8984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.037949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8d67f-a614-471b-a648-5cc0c3ca8984 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.038228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8d67f-a614-471b-a648-5cc0c3ca8984 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.038497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8d67f-a614-471b-a648-5cc0c3ca8984 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.039224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8d67f-a614-471b-a648-5cc0c3ca8984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.040846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8d67f-a614-471b-a648-5cc0c3ca8984 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.052960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1095/2190] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:08.057199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.067659 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763aabc-37d6-479b-ac64-7e04cd8cbb1b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.072376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.073260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.073537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.073837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] PATH_INFO: `/v3/projects/c26394478df34885866475a1dc330910/users/151b551456174d76adcb7fd36521b2be/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.088472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26394478df34885866475a1dc330910, user_id=151b551456174d76adcb7fd36521b2be, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.091117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.106577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1096/2191] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:08 2021] PUT /identity/v3/projects/c26394478df34885866475a1dc330910/users/151b551456174d76adcb7fd36521b2be/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:33:08.117976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db556a-94a0-47c1-b93c-60a79b2a0de2 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.118263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db556a-94a0-47c1-b93c-60a79b2a0de2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.118650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db556a-94a0-47c1-b93c-60a79b2a0de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.147490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f4db556a-94a0-47c1-b93c-60a79b2a0de2 None None] MFA Rules not processed for user `151b551456174d76adcb7fd36521b2be`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:08.148707 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f4db556a-94a0-47c1-b93c-60a79b2a0de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:08.222571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1096/2192] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:08 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:08.227226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.286354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16ccb-83f2-4319-9d36-d209989b4e82 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.291243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.291946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.292227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.292497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.293212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.295122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.322385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1097/2193] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:33:08 2021] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:08.326349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db556a-94a0-47c1-b93c-60a79b2a0de2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.337520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db556a-94a0-47c1-b93c-60a79b2a0de2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.398381 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.399060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.399337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.399736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.400459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.402384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.422917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1097/2194] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:33:08 2021] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:08.426882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.437887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893de7f6-c7b3-42d5-a683-d931a8738299 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.442521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.443187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.443506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.443753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.444481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.446065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.456534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1098/2195] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:08.461041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.472503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bcf56-c3a8-4ed2-b7f3-79c63a9460e4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.478487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.479453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.479739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.480018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] PATH_INFO: `/v3/projects/cd9c4910748247e294f3dbef0297ca09/users/2d650acf615647b69415439114e2004e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.495700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9c4910748247e294f3dbef0297ca09, user_id=2d650acf615647b69415439114e2004e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.498408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.512261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1098/2196] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:08 2021] PUT /identity/v3/projects/cd9c4910748247e294f3dbef0297ca09/users/2d650acf615647b69415439114e2004e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:08.516839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.533025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ec049-5ff0-4a11-b72e-13c6930087d6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.596037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b1ca1-2de8-4854-bc40-4e771a7b5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.596801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b1ca1-2de8-4854-bc40-4e771a7b5c37 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.597111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b1ca1-2de8-4854-bc40-4e771a7b5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.597408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b1ca1-2de8-4854-bc40-4e771a7b5c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.598176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b1ca1-2de8-4854-bc40-4e771a7b5c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.599851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b1ca1-2de8-4854-bc40-4e771a7b5c37 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.610422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1099/2197] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:08 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:08.614685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.625365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694af5a4-9cc5-4d58-8176-9d3859fe21b0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.630392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.631299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.631609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.631882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] PATH_INFO: `/v3/projects/cd9c4910748247e294f3dbef0297ca09/users/2d650acf615647b69415439114e2004e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.633875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9c4910748247e294f3dbef0297ca09, user_id=2d650acf615647b69415439114e2004e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.636617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.647099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1099/2198] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:08 2021] PUT /identity/v3/projects/cd9c4910748247e294f3dbef0297ca09/users/2d650acf615647b69415439114e2004e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:33:08.657738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98168e35-aa07-4f0b-a06c-7c7d09eac0b8 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.658132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98168e35-aa07-4f0b-a06c-7c7d09eac0b8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.658522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98168e35-aa07-4f0b-a06c-7c7d09eac0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.704699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-98168e35-aa07-4f0b-a06c-7c7d09eac0b8 None None] MFA Rules not processed for user `2d650acf615647b69415439114e2004e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:08.705987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-98168e35-aa07-4f0b-a06c-7c7d09eac0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:08.778736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1100/2199] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:08 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:08.789805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.792131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:08.848392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f97ce-270a-4381-b3b0-739a93ead657 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.852222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.852889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.853170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.853446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:08.862572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:08.864121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:08.873640 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1100/2200] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:08 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:08.957835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98168e35-aa07-4f0b-a06c-7c7d09eac0b8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:08.969055 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98168e35-aa07-4f0b-a06c-7c7d09eac0b8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:08.973073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18faef-daa3-4172-9c9d-49c14a88ba08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:08.973752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18faef-daa3-4172-9c9d-49c14a88ba08 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:08.974037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18faef-daa3-4172-9c9d-49c14a88ba08 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:08.974313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18faef-daa3-4172-9c9d-49c14a88ba08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:09.043165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18faef-daa3-4172-9c9d-49c14a88ba08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:09.044675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18faef-daa3-4172-9c9d-49c14a88ba08 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:09.055283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1101/2201] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:08 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:13.817843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:13.885151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c5bf0-9a85-4099-aaea-103fa00c6955 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:13.890880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:13.891779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:13.892061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:13.892334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] PATH_INFO: `/v3/users/151b551456174d76adcb7fd36521b2be` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:13.893667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151b551456174d76adcb7fd36521b2be)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:13.895636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:13.944623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151b551456174d76adcb7fd36521b2be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:13.952540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151b551456174d76adcb7fd36521b2be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:13.953242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151b551456174d76adcb7fd36521b2be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:13.966241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151b551456174d76adcb7fd36521b2be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:13.967065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151b551456174d76adcb7fd36521b2be'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:13.980824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1101/2202] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:33:13 2021] DELETE /identity/v3/users/151b551456174d76adcb7fd36521b2be => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:13.986083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:13.986589 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:13.986715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:14.006050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:14.007292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:14.070837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1102/2203] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:14.078386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:14.079855 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:14.135226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1da15-5578-418e-bd22-2fb701fb6a47 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:14.139423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:14.140074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:14.140358 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:14.140633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:14.151455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:14.152970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:14.163875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1102/2204] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:14.481846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:14.483410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:14.502799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d877c-97f3-473a-9975-c41bd21ab392 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:14.507667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:14.508536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:14.508868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:14.509185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] PATH_INFO: `/v3/projects/c26394478df34885866475a1dc330910` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:14.510515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26394478df34885866475a1dc330910)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:14.512423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:14.562832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26394478df34885866475a1dc330910', 'request_id': 'req-225848dc-9488-4f5e-a072-faf5f5cc369d'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.569398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26394478df34885866475a1dc330910', 'request_id': 'req-225848dc-9488-4f5e-a072-faf5f5cc369d'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.579048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26394478df34885866475a1dc330910', 'request_id': 'req-225848dc-9488-4f5e-a072-faf5f5cc369d'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.589220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] The token cache is being invalidate because project c26394478df34885866475a1dc330910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:33:14.589511 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.590169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.591782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1103/2205] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:33:14 2021] DELETE /identity/v3/projects/c26394478df34885866475a1dc330910 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:14.595917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:14.606184 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c97a36-f76e-4b42-809c-2c3c94e53175 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:14.662642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:14.663715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:14.664001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:14.664278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] PATH_INFO: `/v3/users/2d650acf615647b69415439114e2004e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:14.665581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d650acf615647b69415439114e2004e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:14.667619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:14.716606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d650acf615647b69415439114e2004e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.723118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d650acf615647b69415439114e2004e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.723805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d650acf615647b69415439114e2004e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.734928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d650acf615647b69415439114e2004e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.735627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-42194643-f6e9-4c08-862f-87580fbdd9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d650acf615647b69415439114e2004e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:14.749267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1103/2206] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:33:14 2021] DELETE /identity/v3/users/2d650acf615647b69415439114e2004e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:33:15.054480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.056090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:15.071028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225848dc-9488-4f5e-a072-faf5f5cc369d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.130488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.131380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.131671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.131947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] PATH_INFO: `/v3/projects/cd9c4910748247e294f3dbef0297ca09` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.133221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9c4910748247e294f3dbef0297ca09)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.135150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.187712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9c4910748247e294f3dbef0297ca09', 'request_id': 'req-24771637-dde7-441f-8146-6c579df94480'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:15.193915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9c4910748247e294f3dbef0297ca09', 'request_id': 'req-24771637-dde7-441f-8146-6c579df94480'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:15.202015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9c4910748247e294f3dbef0297ca09', 'request_id': 'req-24771637-dde7-441f-8146-6c579df94480'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:15.212504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] The token cache is being invalidate because project cd9c4910748247e294f3dbef0297ca09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:33:15.212800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:15.213499 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-24771637-dde7-441f-8146-6c579df94480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:15.215618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1104/2207] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:33:15 2021] DELETE /identity/v3/projects/cd9c4910748247e294f3dbef0297ca09 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:15.222709 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7990b2-7b61-4802-a94f-3dd1ef941076 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.223212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7990b2-7b61-4802-a94f-3dd1ef941076 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.223308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7990b2-7b61-4802-a94f-3dd1ef941076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.242167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8a7990b2-7b61-4802-a94f-3dd1ef941076 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:15.243401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8a7990b2-7b61-4802-a94f-3dd1ef941076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:15.312139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1104/2208] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:15.320545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42c11-89b2-4781-9b2f-ca86bf27f9b6 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.320830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42c11-89b2-4781-9b2f-ca86bf27f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.321109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42c11-89b2-4781-9b2f-ca86bf27f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.344007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a5e42c11-89b2-4781-9b2f-ca86bf27f9b6 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:15.346147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a5e42c11-89b2-4781-9b2f-ca86bf27f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:15.357726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1105/2209] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:15.362148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7990b2-7b61-4802-a94f-3dd1ef941076 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.373429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7990b2-7b61-4802-a94f-3dd1ef941076 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.378588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.379252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.379577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.379852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.380594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:33:15.380901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.382505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.395313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1105/2210] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:33:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:33:15.399724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42c11-89b2-4781-9b2f-ca86bf27f9b6 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.409181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42c11-89b2-4781-9b2f-ca86bf27f9b6 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.414224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.415059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.415341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.415646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.416331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.418316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.445034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1106/2211] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:33:15 2021] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:15.450221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.463714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406badd-c907-4513-bd7e-efabe994dc03 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.522670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.523334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.523649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.523922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.524614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.527122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.549792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1106/2212] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:33:15 2021] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:15.554395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.567924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b7c01-c43d-4354-a2ec-b26aa857bfc3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.574613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.575310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.575621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.575895 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.576662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.578359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.589815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1107/2213] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:15 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:15.594073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.604969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324d2c-e966-4e18-86af-50cd52ad1f40 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.610260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b497b-9f39-4104-a782-abbbdf1bb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.610966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b497b-9f39-4104-a782-abbbdf1bb610 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.611277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b497b-9f39-4104-a782-abbbdf1bb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.611587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b497b-9f39-4104-a782-abbbdf1bb610 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.612339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b497b-9f39-4104-a782-abbbdf1bb610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.613954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b497b-9f39-4104-a782-abbbdf1bb610 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.624389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1107/2214] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:15.629020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.643994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2be2d-163e-423a-87e2-b37cc99e8ef3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.649224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.650106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.650382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.650655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] PATH_INFO: `/v3/projects/ba839282268642fbbb9f2497e1c2e166/users/8fa530c5db14400b9042332c3808e477/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.667457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba839282268642fbbb9f2497e1c2e166, user_id=8fa530c5db14400b9042332c3808e477, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.670139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.684849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1108/2215] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:15 2021] PUT /identity/v3/projects/ba839282268642fbbb9f2497e1c2e166/users/8fa530c5db14400b9042332c3808e477/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:15.696204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ddf35-e062-41ae-9247-5584a60e6fc0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.696433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ddf35-e062-41ae-9247-5584a60e6fc0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.696711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ddf35-e062-41ae-9247-5584a60e6fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.727609 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-351ddf35-e062-41ae-9247-5584a60e6fc0 None None] MFA Rules not processed for user `8fa530c5db14400b9042332c3808e477`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:15.728820 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-351ddf35-e062-41ae-9247-5584a60e6fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:15.792335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1108/2216] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:15 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:15.809863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:15.811973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:15.893073 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238ba0-8c9d-4010-8edc-d816e40e7f5d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:15.897255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d4b6b-689c-4d45-ae26-d73007db14a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:15.897880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4b6b-689c-4d45-ae26-d73007db14a7 service glance] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:15.898131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4b6b-689c-4d45-ae26-d73007db14a7 service glance] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:15.898432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4b6b-689c-4d45-ae26-d73007db14a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:15.908031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d4b6b-689c-4d45-ae26-d73007db14a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:15.909453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d4b6b-689c-4d45-ae26-d73007db14a7 service glance] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:15.919187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1109/2217] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:15 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:40.051324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ddf35-e062-41ae-9247-5584a60e6fc0 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:40.117363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ddf35-e062-41ae-9247-5584a60e6fc0 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:40.123595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:40.124527 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:40.124828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:40.125304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] PATH_INFO: `/v3/users/8fa530c5db14400b9042332c3808e477` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:40.126796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa530c5db14400b9042332c3808e477)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:40.128828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:40.175286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa530c5db14400b9042332c3808e477'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.182409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa530c5db14400b9042332c3808e477'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.183263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa530c5db14400b9042332c3808e477'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.195682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa530c5db14400b9042332c3808e477'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.196280 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa530c5db14400b9042332c3808e477'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.210368 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1109/2218] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:33:40 2021] DELETE /identity/v3/users/8fa530c5db14400b9042332c3808e477 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:40.214864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:40.215422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:40.215522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:40.232963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:40.234196 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:40.301391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1110/2219] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:40.311479 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:40.312997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:40.373088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10adf1-3d81-4970-b963-a033e307b189 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:40.378786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdf1e8-1380-4411-b9a6-e53a3380495e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:40.379967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf1e8-1380-4411-b9a6-e53a3380495e service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:40.380440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf1e8-1380-4411-b9a6-e53a3380495e service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:40.380904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf1e8-1380-4411-b9a6-e53a3380495e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:40.396554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdf1e8-1380-4411-b9a6-e53a3380495e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:40.398716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdf1e8-1380-4411-b9a6-e53a3380495e service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:40.414538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1110/2220] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:40.722464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:40.724029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:40.737865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883809e-c6b1-4733-808b-3e5a219fee56 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:40.743268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:40.744350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:40.744660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:40.745064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] PATH_INFO: `/v3/projects/ba839282268642fbbb9f2497e1c2e166` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:40.746487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba839282268642fbbb9f2497e1c2e166)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:40.748456 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:40.806791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba839282268642fbbb9f2497e1c2e166', 'request_id': 'req-bb24b5fa-8933-4def-8353-06620b260e6e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.813896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba839282268642fbbb9f2497e1c2e166', 'request_id': 'req-bb24b5fa-8933-4def-8353-06620b260e6e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.821811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba839282268642fbbb9f2497e1c2e166', 'request_id': 'req-bb24b5fa-8933-4def-8353-06620b260e6e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.832419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] The token cache is being invalidate because project ba839282268642fbbb9f2497e1c2e166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:33:40.832724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.833369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bb24b5fa-8933-4def-8353-06620b260e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:40.834937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1111/2221] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:33:40 2021] DELETE /identity/v3/projects/ba839282268642fbbb9f2497e1c2e166 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:40.840983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2429f-eae1-4715-9f78-93798cb6b340 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:40.841272 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2429f-eae1-4715-9f78-93798cb6b340 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:40.841549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2429f-eae1-4715-9f78-93798cb6b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:40.859985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cac2429f-eae1-4715-9f78-93798cb6b340 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:40.861211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cac2429f-eae1-4715-9f78-93798cb6b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:40.924765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1111/2222] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:40.932535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f59ccf-f88a-4991-bfa9-0762387be5ad None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:40.932879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f59ccf-f88a-4991-bfa9-0762387be5ad None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:40.933068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f59ccf-f88a-4991-bfa9-0762387be5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:40.952450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f2f59ccf-f88a-4991-bfa9-0762387be5ad None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:40.953804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f2f59ccf-f88a-4991-bfa9-0762387be5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:40.962540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1112/2223] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:40.967639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2429f-eae1-4715-9f78-93798cb6b340 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:40.979691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2429f-eae1-4715-9f78-93798cb6b340 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:40.987376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:40.988276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:40.988600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:40.988882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:40.989620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:33:40.989955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:40.991621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.004572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1112/2224] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:33:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:33:41.009578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f59ccf-f88a-4991-bfa9-0762387be5ad None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.019837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f59ccf-f88a-4991-bfa9-0762387be5ad None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.025016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.025709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.026083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.026596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.027753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.030076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.071849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1113/2225] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:33:41 2021] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:41.073560 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.083511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcb072-e796-49eb-8fd9-a0cac48b2595 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.138851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.139561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.139817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.140103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.140809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.142826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.164295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1113/2226] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:33:41 2021] POST /identity/v3/users => generated 280 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:33:41.169116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.180440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8034bb-a642-4f59-a9ce-4faea30d4713 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.185963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.186790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.187158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.187522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.188326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.190431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.201462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1114/2227] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:41.205430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.215173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23715-d114-492c-91bc-40ebcee9cb55 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.219767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505568f-27e5-45d8-825a-0e38f630c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.220420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505568f-27e5-45d8-825a-0e38f630c5bd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.220699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505568f-27e5-45d8-825a-0e38f630c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.220964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505568f-27e5-45d8-825a-0e38f630c5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.221692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505568f-27e5-45d8-825a-0e38f630c5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.223308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505568f-27e5-45d8-825a-0e38f630c5bd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.233331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1114/2228] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:41 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:33:41.237560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.247855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6584e2-34c2-4450-a2e0-a4934d50d7bb admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.252912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.253798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.254079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.254357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] PATH_INFO: `/v3/projects/5b5a9889df454572a6141d04f7e15ee5/users/711dcfa442394433bff6c5d3d76ea570/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.269077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5a9889df454572a6141d04f7e15ee5, user_id=711dcfa442394433bff6c5d3d76ea570, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.271854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.287813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1115/2229] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:41 2021] PUT /identity/v3/projects/5b5a9889df454572a6141d04f7e15ee5/users/711dcfa442394433bff6c5d3d76ea570/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:41.299122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa422fa-8b96-48e8-a21a-0ef50c7a5fbf None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.299447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa422fa-8b96-48e8-a21a-0ef50c7a5fbf None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.299751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa422fa-8b96-48e8-a21a-0ef50c7a5fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.328167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-aaa422fa-8b96-48e8-a21a-0ef50c7a5fbf None None] MFA Rules not processed for user `711dcfa442394433bff6c5d3d76ea570`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:41.329309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-aaa422fa-8b96-48e8-a21a-0ef50c7a5fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:41.404976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1115/2230] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:41 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:41.431478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.433766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:41.492976 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5013-93fd-459f-b79e-037b44497d60 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.497399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00356190-62a4-497b-b3ec-c3f3f35519bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.498036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00356190-62a4-497b-b3ec-c3f3f35519bb service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.498445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00356190-62a4-497b-b3ec-c3f3f35519bb service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.498725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00356190-62a4-497b-b3ec-c3f3f35519bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.508191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00356190-62a4-497b-b3ec-c3f3f35519bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.509773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00356190-62a4-497b-b3ec-c3f3f35519bb service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.519965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1116/2231] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:41 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:41.536607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa422fa-8b96-48e8-a21a-0ef50c7a5fbf None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.601977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa422fa-8b96-48e8-a21a-0ef50c7a5fbf None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.607853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.608743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.609021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.609295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] PATH_INFO: `/v3/users/711dcfa442394433bff6c5d3d76ea570` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.610522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=711dcfa442394433bff6c5d3d76ea570)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.612516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.664466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711dcfa442394433bff6c5d3d76ea570'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:41.671341 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711dcfa442394433bff6c5d3d76ea570'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:41.672029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711dcfa442394433bff6c5d3d76ea570'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:41.687102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711dcfa442394433bff6c5d3d76ea570'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:41.687894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711dcfa442394433bff6c5d3d76ea570'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:41.705064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1116/2232] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:33:41 2021] DELETE /identity/v3/users/711dcfa442394433bff6c5d3d76ea570 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:41.710861 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.711227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.711668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.737911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:41.739191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:41.801270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1117/2233] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:41.814786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:41.816576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:41.875899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc565565-c508-4231-85e6-cff1ddc635b8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:41.879808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ba703-882b-46b9-bd53-eba5a6541b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:41.880441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba703-882b-46b9-bd53-eba5a6541b4b service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:41.880720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba703-882b-46b9-bd53-eba5a6541b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:41.881006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ba703-882b-46b9-bd53-eba5a6541b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:41.890486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ba703-882b-46b9-bd53-eba5a6541b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:41.891958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ba703-882b-46b9-bd53-eba5a6541b4b service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:41.901254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1117/2234] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:33:42.197496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.199025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:42.211300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3925f-22b4-40d5-ae10-52cd404442b5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.216575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.217433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.217714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.217986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] PATH_INFO: `/v3/projects/5b5a9889df454572a6141d04f7e15ee5` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.219178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5a9889df454572a6141d04f7e15ee5)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.223152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.284137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5a9889df454572a6141d04f7e15ee5', 'request_id': 'req-86bc4970-b80c-46e3-971f-87cc3cd4755b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:42.290193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5a9889df454572a6141d04f7e15ee5', 'request_id': 'req-86bc4970-b80c-46e3-971f-87cc3cd4755b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:42.297972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5a9889df454572a6141d04f7e15ee5', 'request_id': 'req-86bc4970-b80c-46e3-971f-87cc3cd4755b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:42.310036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] The token cache is being invalidate because project 5b5a9889df454572a6141d04f7e15ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:33:42.310334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:42.310982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-86bc4970-b80c-46e3-971f-87cc3cd4755b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:33:42.312853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1118/2235] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:33:42 2021] DELETE /identity/v3/projects/5b5a9889df454572a6141d04f7e15ee5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:42.318364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e984d4-3a36-4279-bfd0-d8269d0cf3f9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.318856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e984d4-3a36-4279-bfd0-d8269d0cf3f9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.318963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e984d4-3a36-4279-bfd0-d8269d0cf3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.337465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-49e984d4-3a36-4279-bfd0-d8269d0cf3f9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:42.340654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-49e984d4-3a36-4279-bfd0-d8269d0cf3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:42.403705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1118/2236] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:42.412624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9b421-ee4c-47c5-a140-bb64d88b4038 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.412978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9b421-ee4c-47c5-a140-bb64d88b4038 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.413342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9b421-ee4c-47c5-a140-bb64d88b4038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.437610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-5bb9b421-ee4c-47c5-a140-bb64d88b4038 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:42.438801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5bb9b421-ee4c-47c5-a140-bb64d88b4038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:42.446559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1119/2237] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:33:42.450881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e984d4-3a36-4279-bfd0-d8269d0cf3f9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.461172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e984d4-3a36-4279-bfd0-d8269d0cf3f9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.466412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.467060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.467337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.467661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.468364 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:33:42.468667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.470257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.482378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1119/2238] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:33:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:33:42.487109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9b421-ee4c-47c5-a140-bb64d88b4038 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.497525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9b421-ee4c-47c5-a140-bb64d88b4038 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.504200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.504855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.505135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.505403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.506080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.508072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.535467 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1120/2239] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:33:42 2021] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:33:42.538921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.549633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129d303-329a-4eb7-acb2-c018bfca8caf admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.609360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.610067 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.610352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.610627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.611383 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.613356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.635179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1120/2240] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:33:42 2021] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:33:42.639845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.650391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0f3e3-e805-4a60-b1da-e74c1b71313e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.655466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.656125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.656407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.656683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.657414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.659026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.669750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1121/2241] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:33:42.673700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.685082 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c9134-f10a-42c0-9ef2-be7fc270c840 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.689936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5f56b-776b-45d2-a7a4-36803f0b76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.690591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f56b-776b-45d2-a7a4-36803f0b76d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.690869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f56b-776b-45d2-a7a4-36803f0b76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.691143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f56b-776b-45d2-a7a4-36803f0b76d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.691912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5f56b-776b-45d2-a7a4-36803f0b76d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.693514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5f56b-776b-45d2-a7a4-36803f0b76d6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.703553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1121/2242] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:33:42.709126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.719021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e01ab-d8f7-4221-8dca-f26bace222d3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.723898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.724780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.725059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.725332 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] PATH_INFO: `/v3/projects/332bf1e93a2646ff9cd4865fa2e08690/users/1575d7b4918d4214bc3da2803471a5ed/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.739757 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332bf1e93a2646ff9cd4865fa2e08690, user_id=1575d7b4918d4214bc3da2803471a5ed, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.742545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.756921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1122/2243] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:33:42 2021] PUT /identity/v3/projects/332bf1e93a2646ff9cd4865fa2e08690/users/1575d7b4918d4214bc3da2803471a5ed/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:33:42.767851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.768142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.768417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.794567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] MFA Rules not processed for user `1575d7b4918d4214bc3da2803471a5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:33:42.795808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:42.864241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1122/2244] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:33:42 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:33:42.875582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:33:42.877608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:33:42.937794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52706bbf-74f9-45b3-b975-1d24223123a0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:33:42.941965 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:33:42.942608 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:33:42.942872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:33:42.943164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:33:42.952831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:33:42.954298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:33:42.963813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1123/2245] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:33:42 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:03.361965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:03.364015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:03.444197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca470186-b667-454a-9bec-56f9404acf08 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:03.449102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:03.450151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:03.450611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:03.451241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] PATH_INFO: `/v3/users/81d8642de4a64b80b0a85d69663e2f91` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:03.452161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d8642de4a64b80b0a85d69663e2f91)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:03.454343 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:03.506398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d8642de4a64b80b0a85d69663e2f91'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.513567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d8642de4a64b80b0a85d69663e2f91'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.514235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d8642de4a64b80b0a85d69663e2f91'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.525706 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d8642de4a64b80b0a85d69663e2f91'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.526347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6d121218-6573-4a25-ad07-fe7509f4fc8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d8642de4a64b80b0a85d69663e2f91'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.541174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1123/2246] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:03 2021] DELETE /identity/v3/users/81d8642de4a64b80b0a85d69663e2f91 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:03.755735 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:03.769867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ce0d3-d490-4ba7-bce1-061a94f8ddcf service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:03.856831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:03.857973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:03.858269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:03.858606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] PATH_INFO: `/v3/projects/dec8900e772c45c583c5e85e9958d95d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:03.863505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec8900e772c45c583c5e85e9958d95d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:03.865428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:03.913723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec8900e772c45c583c5e85e9958d95d', 'request_id': 'req-e4dd9975-6238-4c03-a0ae-76c37e5e330e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.920393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec8900e772c45c583c5e85e9958d95d', 'request_id': 'req-e4dd9975-6238-4c03-a0ae-76c37e5e330e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.928868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec8900e772c45c583c5e85e9958d95d', 'request_id': 'req-e4dd9975-6238-4c03-a0ae-76c37e5e330e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.945136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] The token cache is being invalidate because project dec8900e772c45c583c5e85e9958d95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:03.945423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.946126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e4dd9975-6238-4c03-a0ae-76c37e5e330e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:03.947932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1124/2247] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:03 2021] DELETE /identity/v3/projects/dec8900e772c45c583c5e85e9958d95d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:03.954071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f581-e3a4-409b-9653-a8a0e5648515 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:03.954415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f581-e3a4-409b-9653-a8a0e5648515 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:03.954789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84f581-e3a4-409b-9653-a8a0e5648515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:03.972655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1f84f581-e3a4-409b-9653-a8a0e5648515 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:03.973843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1f84f581-e3a4-409b-9653-a8a0e5648515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:04.043502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1124/2248] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:04.053287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927d56-1aa8-4a7a-a929-779b096476e3 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.053675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927d56-1aa8-4a7a-a929-779b096476e3 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.053948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927d56-1aa8-4a7a-a929-779b096476e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.074305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-92927d56-1aa8-4a7a-a929-779b096476e3 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:04.075581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-92927d56-1aa8-4a7a-a929-779b096476e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:04.084298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1125/2249] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:04.088936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f581-e3a4-409b-9653-a8a0e5648515 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.099457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84f581-e3a4-409b-9653-a8a0e5648515 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.105553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.106212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.106643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.106943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.107705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:04.108012 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.109616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.122869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1125/2250] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:34:04.127543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927d56-1aa8-4a7a-a929-779b096476e3 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.137151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927d56-1aa8-4a7a-a929-779b096476e3 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.142269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.142924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.143207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.143519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.144219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.146120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.183404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1126/2251] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:04 2021] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:04.188592 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.202258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2826-c69f-41e4-8fea-1bc7e684be42 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.262314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.263342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.264907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.265225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.265970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.268060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.297508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1126/2252] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:04 2021] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:04.298961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.313230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f6bc-384a-4ce7-8abd-17b03b8ea71c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.319640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.320346 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.320609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.320881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.321610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.323379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.338690 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1127/2253] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:04.340095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.351162 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12f8e-5e3e-4823-baf0-8b30c94fe2a0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.356276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ec6d7-9497-4a3e-b88c-40bfb28595e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.357000 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec6d7-9497-4a3e-b88c-40bfb28595e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.357269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec6d7-9497-4a3e-b88c-40bfb28595e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.357543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ec6d7-9497-4a3e-b88c-40bfb28595e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.358385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec6d7-9497-4a3e-b88c-40bfb28595e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.360025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ec6d7-9497-4a3e-b88c-40bfb28595e2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.374166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1127/2254] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:04.379183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.391417 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34e6e9-df11-46b5-bbae-dd4c0e29c425 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.395596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.396717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.397131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.397474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] PATH_INFO: `/v3/projects/f7a9900d39614dc6a464d7052baa30ef/users/851938da5ca4496ebbf13a334d28a1c5/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.413532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a9900d39614dc6a464d7052baa30ef, user_id=851938da5ca4496ebbf13a334d28a1c5, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.416426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.431154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1128/2255] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:04 2021] PUT /identity/v3/projects/f7a9900d39614dc6a464d7052baa30ef/users/851938da5ca4496ebbf13a334d28a1c5/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:04.441863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937dc4-44ad-4ef6-b577-2f6358e703ef None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.442153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937dc4-44ad-4ef6-b577-2f6358e703ef None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.442432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937dc4-44ad-4ef6-b577-2f6358e703ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.472328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0f937dc4-44ad-4ef6-b577-2f6358e703ef None None] MFA Rules not processed for user `851938da5ca4496ebbf13a334d28a1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:04.473652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0f937dc4-44ad-4ef6-b577-2f6358e703ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:04.546942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1128/2256] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:04 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:04.551869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.619419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ef098-8d6f-48ce-8475-4da2c7ade3fe admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.624837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.625507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.625790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.626067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.626781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.628727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.655742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1129/2257] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:04 2021] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:04.660688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937dc4-44ad-4ef6-b577-2f6358e703ef None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.677776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937dc4-44ad-4ef6-b577-2f6358e703ef None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.735501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.736285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.736586 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.736827 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.738083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.740932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.764179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1129/2258] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:04 2021] POST /identity/v3/users => generated 308 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:04.768243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.779190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e84b-76f5-41e3-b6cf-02135a373150 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.784683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.785355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.785638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.785942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.786724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.788395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.799810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1130/2259] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:04.804546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.816540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cf6fb-c026-407d-a7be-9c8cca1aa546 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.822967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.823971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.824275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.824572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] PATH_INFO: `/v3/projects/89e4b4d0af4a430ba00b285b63dbdf07/users/a95525a5d2d345fcab493cfe2c3fd5bb/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.842101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e4b4d0af4a430ba00b285b63dbdf07, user_id=a95525a5d2d345fcab493cfe2c3fd5bb, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.845247 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.858914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1130/2260] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:04 2021] PUT /identity/v3/projects/89e4b4d0af4a430ba00b285b63dbdf07/users/a95525a5d2d345fcab493cfe2c3fd5bb/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:04.863284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.874726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e0776-ed76-4e5a-a469-7020df15e2d1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.944076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026a001-e088-4b44-b0a5-ea026256194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.944751 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a001-e088-4b44-b0a5-ea026256194d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.945034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a001-e088-4b44-b0a5-ea026256194d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.945320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026a001-e088-4b44-b0a5-ea026256194d admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.946040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026a001-e088-4b44-b0a5-ea026256194d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.947661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026a001-e088-4b44-b0a5-ea026256194d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.957472 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1131/2261] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:04 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:04.961949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:04.973973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827bda0-410a-4fc9-8d8f-8fd7ca46cd9c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:04.980309 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:04.981217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:04.981766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:04.982536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] PATH_INFO: `/v3/projects/89e4b4d0af4a430ba00b285b63dbdf07/users/a95525a5d2d345fcab493cfe2c3fd5bb/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:04.984643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e4b4d0af4a430ba00b285b63dbdf07, user_id=a95525a5d2d345fcab493cfe2c3fd5bb, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:04.987545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:04.998908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1131/2262] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:04 2021] PUT /identity/v3/projects/89e4b4d0af4a430ba00b285b63dbdf07/users/a95525a5d2d345fcab493cfe2c3fd5bb/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:05.010279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0791e68-27d5-4b46-89ea-ee0bc641763d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:05.010571 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0791e68-27d5-4b46-89ea-ee0bc641763d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:05.010847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0791e68-27d5-4b46-89ea-ee0bc641763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:05.039778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f0791e68-27d5-4b46-89ea-ee0bc641763d None None] MFA Rules not processed for user `a95525a5d2d345fcab493cfe2c3fd5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:05.041030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f0791e68-27d5-4b46-89ea-ee0bc641763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:05.114355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1132/2263] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:05 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:05.124541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:05.126427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:05.191185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcea97-6cd2-44ec-aa81-9954cc573a51 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:05.195768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4fc3-f86a-4d7a-a476-47085b01a1f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:05.196413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4fc3-f86a-4d7a-a476-47085b01a1f5 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:05.196696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4fc3-f86a-4d7a-a476-47085b01a1f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:05.196972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4fc3-f86a-4d7a-a476-47085b01a1f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:05.206954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4fc3-f86a-4d7a-a476-47085b01a1f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:05.208434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4fc3-f86a-4d7a-a476-47085b01a1f5 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:05.220007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1132/2264] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:05 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:05.378566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0791e68-27d5-4b46-89ea-ee0bc641763d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:05.447210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0791e68-27d5-4b46-89ea-ee0bc641763d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:05.455304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:05.456216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:05.456605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:05.456917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] PATH_INFO: `/v3/users/851938da5ca4496ebbf13a334d28a1c5` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:05.458190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851938da5ca4496ebbf13a334d28a1c5)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:05.460393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:05.513706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851938da5ca4496ebbf13a334d28a1c5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:05.531404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851938da5ca4496ebbf13a334d28a1c5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:05.539198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851938da5ca4496ebbf13a334d28a1c5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:05.540052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851938da5ca4496ebbf13a334d28a1c5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:05.549316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851938da5ca4496ebbf13a334d28a1c5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:05.555865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1133/2265] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:05 2021] DELETE /identity/v3/users/851938da5ca4496ebbf13a334d28a1c5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:05.561266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:05.562254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:05.562254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:05.579819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:05.581032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:05.644086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1133/2266] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:05.656554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:05.658392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:05.727830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a2f7f-1021-44f4-bea5-96b43237e0b1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:05.732635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:05.733344 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:05.733609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:05.733883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:05.743382 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:05.744841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:05.754397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1134/2267] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:06.125506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.127080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:06.149212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d87129-d918-45e3-8af9-a4fba102f6e8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.155665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.156626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.156898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.157173 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] PATH_INFO: `/v3/projects/f7a9900d39614dc6a464d7052baa30ef` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.158380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a9900d39614dc6a464d7052baa30ef)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.160547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.175141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.176797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:06.190357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540149-cad1-4c74-bab6-994cfc62adf7 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.195081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.195984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.196264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.196535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] PATH_INFO: `/v3/users/6faa1a83294641068232fe1b173af45e` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.197717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6faa1a83294641068232fe1b173af45e)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.199650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.223552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a9900d39614dc6a464d7052baa30ef', 'request_id': 'req-37991bc5-e3a5-41be-b960-ae08e3ae7f70'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.229892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a9900d39614dc6a464d7052baa30ef', 'request_id': 'req-37991bc5-e3a5-41be-b960-ae08e3ae7f70'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.236148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a9900d39614dc6a464d7052baa30ef', 'request_id': 'req-37991bc5-e3a5-41be-b960-ae08e3ae7f70'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.246667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6faa1a83294641068232fe1b173af45e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.249060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] The token cache is being invalidate because project f7a9900d39614dc6a464d7052baa30ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:06.249544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.251873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.253691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1134/2268] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:06 2021] DELETE /identity/v3/projects/f7a9900d39614dc6a464d7052baa30ef => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:06.257580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.259083 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:06.259842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6faa1a83294641068232fe1b173af45e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.267971 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6faa1a83294641068232fe1b173af45e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.268722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6faa1a83294641068232fe1b173af45e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.277824 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6faa1a83294641068232fe1b173af45e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.289142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1135/2269] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:06 2021] DELETE /identity/v3/users/6faa1a83294641068232fe1b173af45e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:06.333913 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37991bc5-e3a5-41be-b960-ae08e3ae7f70 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.400070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.401177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.401457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.401725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] PATH_INFO: `/v3/users/a95525a5d2d345fcab493cfe2c3fd5bb` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.402933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95525a5d2d345fcab493cfe2c3fd5bb)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.405440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.472170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95525a5d2d345fcab493cfe2c3fd5bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.480149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95525a5d2d345fcab493cfe2c3fd5bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.480985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95525a5d2d345fcab493cfe2c3fd5bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.493090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.494700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:06.519892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0b5d6-29eb-435d-bbb3-593153220efe admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.521544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95525a5d2d345fcab493cfe2c3fd5bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.522525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00b8f3f0-0e71-4a73-ba3a-346719394c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95525a5d2d345fcab493cfe2c3fd5bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.525538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.526671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.527578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.527968 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] PATH_INFO: `/v3/projects/7dd6a8224c1149f6a978d9174fa5a7ee` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.529428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd6a8224c1149f6a978d9174fa5a7ee)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.531665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.540751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1135/2270] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:06 2021] DELETE /identity/v3/users/a95525a5d2d345fcab493cfe2c3fd5bb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:06.583738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd6a8224c1149f6a978d9174fa5a7ee', 'request_id': 'req-7a387a98-ef29-426a-9e50-d6c4e159e67f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.590660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd6a8224c1149f6a978d9174fa5a7ee', 'request_id': 'req-7a387a98-ef29-426a-9e50-d6c4e159e67f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.602615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd6a8224c1149f6a978d9174fa5a7ee', 'request_id': 'req-7a387a98-ef29-426a-9e50-d6c4e159e67f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.622268 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] The token cache is being invalidate because project 7dd6a8224c1149f6a978d9174fa5a7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:06.623152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.624168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7a387a98-ef29-426a-9e50-d6c4e159e67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:06.628107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1136/2271] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:06 2021] DELETE /identity/v3/projects/7dd6a8224c1149f6a978d9174fa5a7ee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:06.634741 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2ef62-b1f6-4c5c-94f3-87e7010abfa9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.635307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2ef62-b1f6-4c5c-94f3-87e7010abfa9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.635307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2ef62-b1f6-4c5c-94f3-87e7010abfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.659905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-6fc2ef62-b1f6-4c5c-94f3-87e7010abfa9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:06.666229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6fc2ef62-b1f6-4c5c-94f3-87e7010abfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:06.733655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1136/2272] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:06.741540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8d48-8cc9-45bd-83d9-20f1103f0844 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.741851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8d48-8cc9-45bd-83d9-20f1103f0844 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.742142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8d48-8cc9-45bd-83d9-20f1103f0844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.762048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-df6d8d48-8cc9-45bd-83d9-20f1103f0844 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:06.763504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-df6d8d48-8cc9-45bd-83d9-20f1103f0844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:06.772135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1137/2273] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:06.776347 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2ef62-b1f6-4c5c-94f3-87e7010abfa9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.786265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2ef62-b1f6-4c5c-94f3-87e7010abfa9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.791106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.791836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.792333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.797257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.797257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:06.797257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.797257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.808156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1137/2274] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:34:06.812900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8d48-8cc9-45bd-83d9-20f1103f0844 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.822155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8d48-8cc9-45bd-83d9-20f1103f0844 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.827144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.827849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.828134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.828409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.829150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.831197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.862225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1138/2275] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:06 2021] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:06.863451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.867769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.869733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:06.880517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793da470-98a8-42ab-9567-5f987103df71 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.940263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ae52c-9669-42db-8fe1-638a4b23d236 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:06.947385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.947710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:06.948045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.948374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.948647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] PATH_INFO: `/v3/projects/89e4b4d0af4a430ba00b285b63dbdf07` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.948757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:06.949113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:06.949632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:06.950122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e4b4d0af4a430ba00b285b63dbdf07)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.950492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:06.952067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.952536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:06.974335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1138/2276] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:06 2021] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:06.978407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:06.989263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57aa7-54af-483d-b403-8f9536b8eb8b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.003978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e4b4d0af4a430ba00b285b63dbdf07', 'request_id': 'req-087f63bd-03ba-4b09-a2d7-f8cc6274f180'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:07.010243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e4b4d0af4a430ba00b285b63dbdf07', 'request_id': 'req-087f63bd-03ba-4b09-a2d7-f8cc6274f180'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:07.018768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e4b4d0af4a430ba00b285b63dbdf07', 'request_id': 'req-087f63bd-03ba-4b09-a2d7-f8cc6274f180'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:07.028872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] The token cache is being invalidate because project 89e4b4d0af4a430ba00b285b63dbdf07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:07.029156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:07.029793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-087f63bd-03ba-4b09-a2d7-f8cc6274f180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:07.031338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1139/2277] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:06 2021] DELETE /identity/v3/projects/89e4b4d0af4a430ba00b285b63dbdf07 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:07.036932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2f49-4871-4bf1-943b-58a68366f561 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.037242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2f49-4871-4bf1-943b-58a68366f561 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.037531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2f49-4871-4bf1-943b-58a68366f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.048099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.048713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.048973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.049225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.049968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.051603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.055931 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-03de2f49-4871-4bf1-943b-58a68366f561 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:07.057176 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-03de2f49-4871-4bf1-943b-58a68366f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:07.061774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1139/2278] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:06 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:07.065844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.066393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1140/2279] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:07.068722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:07.074863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1235a-b221-49ab-8f1f-27535e0dd7d5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.075513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1235a-b221-49ab-8f1f-27535e0dd7d5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.076009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1235a-b221-49ab-8f1f-27535e0dd7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.082826 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30cb6c-1cf9-44fa-8233-7b5628dff702 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.088174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.088848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.089276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.089543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.090262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.092424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.098379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8ed1235a-b221-49ab-8f1f-27535e0dd7d5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:07.099725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8ed1235a-b221-49ab-8f1f-27535e0dd7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:07.105711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1140/2280] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:07.106834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.108201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1141/2281] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:07.112154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1235a-b221-49ab-8f1f-27535e0dd7d5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.119714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c4405-c034-4a24-8189-05891b2f33e7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.120893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1235a-b221-49ab-8f1f-27535e0dd7d5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.124552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc756ee-bfa9-4f12-b661-c205c579be17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.125460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc756ee-bfa9-4f12-b661-c205c579be17 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.125733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc756ee-bfa9-4f12-b661-c205c579be17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.125961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.126090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc756ee-bfa9-4f12-b661-c205c579be17 admin admin] PATH_INFO: `/v3/projects/6a14146ea7344155b5f7ca9e3a17303d/users/57d668a8af8c4a01a52bb5ee116e1d67/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.126605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.126886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.127160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.127956 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:07.128283 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.129874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.143264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1142/2282] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:34:07.146063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc756ee-bfa9-4f12-b661-c205c579be17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a14146ea7344155b5f7ca9e3a17303d, user_id=57d668a8af8c4a01a52bb5ee116e1d67, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.148302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.149137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc756ee-bfa9-4f12-b661-c205c579be17 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.158649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5939f-62d2-4e37-b04e-10edaca840d0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.163598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.164255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.164535 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.164805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.165494 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.167449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.167994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1141/2283] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:07 2021] PUT /identity/v3/projects/6a14146ea7344155b5f7ca9e3a17303d/users/57d668a8af8c4a01a52bb5ee116e1d67/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:07.178851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.179341 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.179648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.206060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1143/2284] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/projects => generated 357 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:07.208128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] MFA Rules not processed for user `57d668a8af8c4a01a52bb5ee116e1d67`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:07.209352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:07.210030 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.273414 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1142/2285] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:07.277230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8598621-b4dc-4d92-aa4b-7b8ceca894fe admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.282885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.283436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.283611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.283955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.284173 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.284903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.285092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:07.286934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.308093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1144/2286] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:07.312539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.323466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2c0df-ab9e-4d4a-9648-7b9a4027ab0a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.330427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.331115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.331427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.331704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.332439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.334041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.345100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1145/2287] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:07.346456 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31946b52-60a4-42a2-8d8c-6228542cce49 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.349387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.350460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.351171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.351482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.351754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.359200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b8f9f-23ac-42be-81e3-79b1bf04ed02 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.360604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.362070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.364216 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4e0f-3648-4d44-9e3e-62128e8b37e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.364886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4e0f-3648-4d44-9e3e-62128e8b37e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.365168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4e0f-3648-4d44-9e3e-62128e8b37e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.365447 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4e0f-3648-4d44-9e3e-62128e8b37e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.366304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4e0f-3648-4d44-9e3e-62128e8b37e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.367924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4e0f-3648-4d44-9e3e-62128e8b37e3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.372210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1143/2288] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:07 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:34:07.381730 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1146/2289] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:07.382808 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.394133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876ebb9-9259-43a6-91b7-2b92c8948cd1 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.400075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.401100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.401339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.401616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] PATH_INFO: `/v3/projects/da2cf7091e0149809c9ef4540c3ba79d/users/8c206568ef44456082e79adb0ba6b559/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.417950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2cf7091e0149809c9ef4540c3ba79d, user_id=8c206568ef44456082e79adb0ba6b559, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.421285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.437081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1144/2290] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:07 2021] PUT /identity/v3/projects/da2cf7091e0149809c9ef4540c3ba79d/users/8c206568ef44456082e79adb0ba6b559/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:07.447459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf0f5b-d197-4bff-9385-faa2da41fe01 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.447734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf0f5b-d197-4bff-9385-faa2da41fe01 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.448014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf0f5b-d197-4bff-9385-faa2da41fe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.478699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3ebf0f5b-d197-4bff-9385-faa2da41fe01 None None] MFA Rules not processed for user `8c206568ef44456082e79adb0ba6b559`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:07.480045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3ebf0f5b-d197-4bff-9385-faa2da41fe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:07.546433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1147/2291] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:07.551270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.627374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86889cc-a57e-4dab-bbe7-1595ec766ea6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.632641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.633675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.633957 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.634242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.634938 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.645503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.684763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1145/2292] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/projects => generated 357 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:07.686269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf0f5b-d197-4bff-9385-faa2da41fe01 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.701638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf0f5b-d197-4bff-9385-faa2da41fe01 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.761261 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.761938 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.762223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.762603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.763321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.765251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.786132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1148/2293] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:07 2021] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:07.790220 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.801130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f73375-229f-44bd-ac38-8f0d932e2f29 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.807401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.808069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.808354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.808616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.809436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.811185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.825608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1146/2294] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:07.826778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.837067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579de19-1a67-4228-ba03-b90e48b1f5b7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.843224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.844275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.844559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.844832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] PATH_INFO: `/v3/projects/ea61a8340cc14a61b95b4416d0ba9584/users/9ef0796a92af4e5c8dfe7a7e548884b9/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.861172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea61a8340cc14a61b95b4416d0ba9584, user_id=9ef0796a92af4e5c8dfe7a7e548884b9, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.863862 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.877641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1149/2295] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:07 2021] PUT /identity/v3/projects/ea61a8340cc14a61b95b4416d0ba9584/users/9ef0796a92af4e5c8dfe7a7e548884b9/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:07.881896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.893094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778a65a-ba52-48e9-b401-2ca566ce3ad6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.953253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2123d-9986-4c49-880b-d864e5a43e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.954055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2123d-9986-4c49-880b-d864e5a43e4f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.954424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2123d-9986-4c49-880b-d864e5a43e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.954790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2123d-9986-4c49-880b-d864e5a43e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.955688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2123d-9986-4c49-880b-d864e5a43e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.957565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2123d-9986-4c49-880b-d864e5a43e4f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:07.969550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1147/2296] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:07 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:07.974138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:07.985304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4218e-14ee-4162-af9e-c4d67a166362 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:07.990481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:07.991521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:07.991834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:07.992145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] PATH_INFO: `/v3/projects/ea61a8340cc14a61b95b4416d0ba9584/users/9ef0796a92af4e5c8dfe7a7e548884b9/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:07.994188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea61a8340cc14a61b95b4416d0ba9584, user_id=9ef0796a92af4e5c8dfe7a7e548884b9, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:07.997048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:08.009182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1150/2297] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:07 2021] PUT /identity/v3/projects/ea61a8340cc14a61b95b4416d0ba9584/users/9ef0796a92af4e5c8dfe7a7e548884b9/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:08.022227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8fe5-be50-45d8-bb2e-d1e14a65abdb None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:08.022482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8fe5-be50-45d8-bb2e-d1e14a65abdb None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:08.022767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf8fe5-be50-45d8-bb2e-d1e14a65abdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:08.052240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-abdf8fe5-be50-45d8-bb2e-d1e14a65abdb None None] MFA Rules not processed for user `9ef0796a92af4e5c8dfe7a7e548884b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:08.053891 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-abdf8fe5-be50-45d8-bb2e-d1e14a65abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:08.121699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1148/2298] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:08 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:08.132880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:08.196314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810294b-52dc-4a1a-9f5a-76b44d2e151c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:08.202446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:08.203092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:08.203376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:08.203683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:08.213364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:08.214825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:08.225137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1151/2299] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:08 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:08.321011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8fe5-be50-45d8-bb2e-d1e14a65abdb None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:08.331671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf8fe5-be50-45d8-bb2e-d1e14a65abdb None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:08.335951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:08.336589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:08.336890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:08.337160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:08.398184 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:08.399784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:08.409633 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1149/2300] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:08 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:11.477599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:11.480192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:11.545916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69c04-3116-4d0c-bf23-c59d30b67983 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:11.550019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe91a3-97c7-42be-a6ae-d81bef44350c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:11.550658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe91a3-97c7-42be-a6ae-d81bef44350c service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:11.550942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe91a3-97c7-42be-a6ae-d81bef44350c service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:11.551214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe91a3-97c7-42be-a6ae-d81bef44350c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:11.553624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-38fe91a3-97c7-42be-a6ae-d81bef44350c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:11.639973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe91a3-97c7-42be-a6ae-d81bef44350c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:11.641408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe91a3-97c7-42be-a6ae-d81bef44350c service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:11.652536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1152/2301] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:14.361982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:14.380662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a9da-7dba-4eec-9733-c8818d892bb5 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:14.385064 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:14.386505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:14.386962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:14.387658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:14.390549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:14.411420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:14.413656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:14.430734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1150/2302] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:14 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:21.163654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:21.164127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:21.164243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:21.183336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] MFA Rules not processed for user `75cb79bac8944976a2689f62b8d014e2`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:21.184820 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:21.243408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1153/2303] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:21 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:21.556683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:21.565361 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaab7b7-ba27-430f-ac87-0b05530be9cc service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:21.569195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:21.569836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:21.570113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:21.570386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:21.572180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:21.581949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:21.583398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:21.592962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1151/2304] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:21.931380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:21.932975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:22.010279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326fdb7-c295-4558-9734-a46f310dbbbf None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:22.016418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:22.017087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:22.017373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:22.018429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:22.020872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:22.036265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:22.037947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:22.049843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1154/2305] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:21 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:23.071373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:23.080398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d05754-37e2-4a01-be5e-12be2b561ccf service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:23.089606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7d3e7-9ab0-4911-9407-a5d43b813770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:23.090844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7d3e7-9ab0-4911-9407-a5d43b813770 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:23.091226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7d3e7-9ab0-4911-9407-a5d43b813770 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:23.091626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7d3e7-9ab0-4911-9407-a5d43b813770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:23.094034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-62c7d3e7-9ab0-4911-9407-a5d43b813770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:23.109498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7d3e7-9ab0-4911-9407-a5d43b813770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:23.111815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7d3e7-9ab0-4911-9407-a5d43b813770 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:23.123417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1152/2306] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:23 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:26.630185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:26.720538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16d462-c9aa-4e56-be4c-dcb1a8283b07 service placement] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:26.725970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:26.727037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:26.727559 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:26.727859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] PATH_INFO: `/v3/users/57d668a8af8c4a01a52bb5ee116e1d67` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:26.729260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d668a8af8c4a01a52bb5ee116e1d67)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:26.732427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:26.795663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d668a8af8c4a01a52bb5ee116e1d67'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:26.818864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d668a8af8c4a01a52bb5ee116e1d67'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:26.826156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d668a8af8c4a01a52bb5ee116e1d67'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:26.826908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d668a8af8c4a01a52bb5ee116e1d67'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:26.835175 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d668a8af8c4a01a52bb5ee116e1d67'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:26.841913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1155/2307] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:26 2021] DELETE /identity/v3/users/57d668a8af8c4a01a52bb5ee116e1d67 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:26.847032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:26.847622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:26.847886 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:26.868300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:26.869516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:26.932723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1153/2308] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:26.945387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:26.946856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.006491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2cc66-9d42-4d43-b120-0595e92bafdf admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.010909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e006e-5d5d-4e08-8345-402b1019b42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.011602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e006e-5d5d-4e08-8345-402b1019b42c service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.011879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e006e-5d5d-4e08-8345-402b1019b42c service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.012102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e006e-5d5d-4e08-8345-402b1019b42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.022709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e006e-5d5d-4e08-8345-402b1019b42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.024188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e006e-5d5d-4e08-8345-402b1019b42c service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.034067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1156/2309] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:27.321858 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.323291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.337315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86df3f-2741-4f91-b49a-23228f436e0f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.343799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.344754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.345153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.345418 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] PATH_INFO: `/v3/projects/6a14146ea7344155b5f7ca9e3a17303d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.346642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a14146ea7344155b5f7ca9e3a17303d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.348641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.402120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a14146ea7344155b5f7ca9e3a17303d', 'request_id': 'req-dd41c010-4923-43a6-a3f5-81edb1d9034e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.409072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a14146ea7344155b5f7ca9e3a17303d', 'request_id': 'req-dd41c010-4923-43a6-a3f5-81edb1d9034e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.417508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a14146ea7344155b5f7ca9e3a17303d', 'request_id': 'req-dd41c010-4923-43a6-a3f5-81edb1d9034e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.432460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] The token cache is being invalidate because project 6a14146ea7344155b5f7ca9e3a17303d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:27.432772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.433389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-dd41c010-4923-43a6-a3f5-81edb1d9034e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.435084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1154/2310] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:27 2021] DELETE /identity/v3/projects/6a14146ea7344155b5f7ca9e3a17303d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:27.441688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8fc1b-c955-4de7-9341-8b13ae172924 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.442004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8fc1b-c955-4de7-9341-8b13ae172924 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.442451 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8fc1b-c955-4de7-9341-8b13ae172924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.463776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1bb8fc1b-c955-4de7-9341-8b13ae172924 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:27.463776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1bb8fc1b-c955-4de7-9341-8b13ae172924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.524116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1157/2311] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:27.532959 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5fdaa-9375-4e70-aa58-df903ba7c68f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.533301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5fdaa-9375-4e70-aa58-df903ba7c68f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.533583 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5fdaa-9375-4e70-aa58-df903ba7c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.553210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ccd5fdaa-9375-4e70-aa58-df903ba7c68f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:27.554457 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ccd5fdaa-9375-4e70-aa58-df903ba7c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.563275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1155/2312] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:27.567496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8fc1b-c955-4de7-9341-8b13ae172924 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.577873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8fc1b-c955-4de7-9341-8b13ae172924 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.583620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.584278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.584562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.584835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.585564 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:27.586046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.587872 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.600697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1158/2313] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:34:27.605685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5fdaa-9375-4e70-aa58-df903ba7c68f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.615775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5fdaa-9375-4e70-aa58-df903ba7c68f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.621152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.621901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.622316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.622889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.623867 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.625965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.646929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.648826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.658332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1156/2314] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:27 2021] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:27.662151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.665464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae4e1c-8efe-4a9c-86db-1f998a0b642e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.729393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.730524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.730815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.731094 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] PATH_INFO: `/v3/users/8c206568ef44456082e79adb0ba6b559` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.732561 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c206568ef44456082e79adb0ba6b559)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.734502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.734801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fdc48-7f98-4ead-b027-891d429ee5e7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.740079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.740768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.741122 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.741435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.742141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.744299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.771899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1157/2315] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:27 2021] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:27.776925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.789574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70613a51-aef5-4e04-9074-3fa26eeef900 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.794634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.795444 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.795800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.796079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.796648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c206568ef44456082e79adb0ba6b559'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.796824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.798502 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.808947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1158/2316] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:27.809288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c206568ef44456082e79adb0ba6b559'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.812690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.816696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c206568ef44456082e79adb0ba6b559'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.817402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c206568ef44456082e79adb0ba6b559'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.822600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3b2f3-5792-42de-90c3-93a3ac40badf admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.824798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-46561e49-a6b7-457d-94ab-bd1fc5612162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c206568ef44456082e79adb0ba6b559'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:27.828287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.829061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.829349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.829632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.830356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.830947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1159/2317] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:27 2021] DELETE /identity/v3/users/8c206568ef44456082e79adb0ba6b559 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:27.831993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.834910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.835256 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.835561 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.846125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1159/2318] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:27.850876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.852665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.853138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:27.854427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.866669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123bf08-2f87-42ca-899a-f9ef218ddf09 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:27.916384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1160/2319] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:27.927138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:27.929167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.930196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a96e5-aefd-42dc-9b7f-a29b72976b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:27.931142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a96e5-aefd-42dc-9b7f-a29b72976b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.931520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a96e5-aefd-42dc-9b7f-a29b72976b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.931737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a96e5-aefd-42dc-9b7f-a29b72976b86 admin admin] PATH_INFO: `/v3/projects/c24d36ba6b374775b93c113837910ba6/users/8b241530f5bd4149a6dca50a1bd023e1/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.947033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a96e5-aefd-42dc-9b7f-a29b72976b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24d36ba6b374775b93c113837910ba6, user_id=8b241530f5bd4149a6dca50a1bd023e1, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:27.949925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a96e5-aefd-42dc-9b7f-a29b72976b86 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:27.965662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1160/2320] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:27 2021] PUT /identity/v3/projects/c24d36ba6b374775b93c113837910ba6/users/8b241530f5bd4149a6dca50a1bd023e1/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:27.971512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:27.972007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:27.972471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:27.992881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:27.994106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:27.999378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65df42-f84d-45ae-bca3-993cbf722197 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:28.047117 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:28.047810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:28.048091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:28.048365 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:28.053222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1161/2321] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:28.058078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:28.059590 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:28.063340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:28.064704 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:28.069439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1161/2322] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:34:28.076819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da236484-3198-47a4-9fca-3c5eca1e2b4c None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:28.080747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:28.081393 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:28.081789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:28.082088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:28.091739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:28.093163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:28.102687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1162/2323] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:34:28.427668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:28.429653 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:28.448760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993e1d-17bb-46b2-bd96-5e18b7539e09 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:28.453802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:28.454681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:28.454959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:28.455715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] PATH_INFO: `/v3/projects/da2cf7091e0149809c9ef4540c3ba79d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:28.456601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2cf7091e0149809c9ef4540c3ba79d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:28.459019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:28.525850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2cf7091e0149809c9ef4540c3ba79d', 'request_id': 'req-617ac86c-2468-49a8-8336-7e91060a0cfe'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.532966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2cf7091e0149809c9ef4540c3ba79d', 'request_id': 'req-617ac86c-2468-49a8-8336-7e91060a0cfe'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.541260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2cf7091e0149809c9ef4540c3ba79d', 'request_id': 'req-617ac86c-2468-49a8-8336-7e91060a0cfe'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.551598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] The token cache is being invalidate because project da2cf7091e0149809c9ef4540c3ba79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:28.551885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.552815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.554359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1162/2324] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:28 2021] DELETE /identity/v3/projects/da2cf7091e0149809c9ef4540c3ba79d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:28.558448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:28.568657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca05ca-4489-4704-8e42-550e5b49ece5 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:28.637687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:28.638756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:28.639027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:28.639295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] PATH_INFO: `/v3/users/9ef0796a92af4e5c8dfe7a7e548884b9` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:28.640765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef0796a92af4e5c8dfe7a7e548884b9)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:28.642678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:28.697870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef0796a92af4e5c8dfe7a7e548884b9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.705771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef0796a92af4e5c8dfe7a7e548884b9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.706578 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef0796a92af4e5c8dfe7a7e548884b9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.719474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef0796a92af4e5c8dfe7a7e548884b9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.720255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e819fc46-7b8c-421e-85ad-0c5a8319216a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef0796a92af4e5c8dfe7a7e548884b9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:28.736943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1163/2325] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:28 2021] DELETE /identity/v3/users/9ef0796a92af4e5c8dfe7a7e548884b9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:29.333068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:29.335431 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:29.354092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ac86c-2468-49a8-8336-7e91060a0cfe admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:29.435249 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:29.436570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.437052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.437485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] PATH_INFO: `/v3/projects/ea61a8340cc14a61b95b4416d0ba9584` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.439032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea61a8340cc14a61b95b4416d0ba9584)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:29.441153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:29.492063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea61a8340cc14a61b95b4416d0ba9584', 'request_id': 'req-73b84263-4803-4382-a65a-4f86090ff039'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:29.498988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea61a8340cc14a61b95b4416d0ba9584', 'request_id': 'req-73b84263-4803-4382-a65a-4f86090ff039'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:29.508181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea61a8340cc14a61b95b4416d0ba9584', 'request_id': 'req-73b84263-4803-4382-a65a-4f86090ff039'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:29.520663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] The token cache is being invalidate because project ea61a8340cc14a61b95b4416d0ba9584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:29.520952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:29.521591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-73b84263-4803-4382-a65a-4f86090ff039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:29.523141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1163/2326] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:29 2021] DELETE /identity/v3/projects/ea61a8340cc14a61b95b4416d0ba9584 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:29.530265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32601f-339a-4f27-89b7-e94e58cb5e8a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.530738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32601f-339a-4f27-89b7-e94e58cb5e8a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.530935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32601f-339a-4f27-89b7-e94e58cb5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.550777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-9a32601f-339a-4f27-89b7-e94e58cb5e8a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:29.553098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9a32601f-339a-4f27-89b7-e94e58cb5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:29.619948 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1164/2327] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:29.627793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbf7f-de0b-465d-977e-7dfafd7e1248 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.628084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbf7f-de0b-465d-977e-7dfafd7e1248 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.628359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecbf7f-de0b-465d-977e-7dfafd7e1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.651430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-83ecbf7f-de0b-465d-977e-7dfafd7e1248 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:29.653716 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-83ecbf7f-de0b-465d-977e-7dfafd7e1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:29.671594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1164/2328] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:29.671943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32601f-339a-4f27-89b7-e94e58cb5e8a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:29.685852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32601f-339a-4f27-89b7-e94e58cb5e8a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:29.692512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:29.693324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.693701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.694047 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.694934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:29.695520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:29.697643 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:29.712439 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1165/2329] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:34:29.716699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecbf7f-de0b-465d-977e-7dfafd7e1248 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:29.726191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecbf7f-de0b-465d-977e-7dfafd7e1248 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:29.732414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:29.733390 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.733838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.734275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.734996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:29.737119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:29.780188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1165/2330] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:29 2021] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:29.784348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:29.794508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6824c8-4951-4303-a53a-714c6f064f97 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:29.853436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:29.854147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.854430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.854705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.855465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:29.857765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:29.881838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1166/2331] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:29 2021] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:29.886329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:29.898285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce3c7a-44e8-4ea9-9c13-13ea0e8ab99f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:29.906913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:29.907925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.908301 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.908639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.909668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:29.912507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:29.931763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1166/2332] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:29 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:29.935151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:29.946689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d111bd-c6a2-49b8-aa7a-36a597012c84 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:29.954846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5ea1c-2c91-4bf5-9ff6-9dd41dc05af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:29.954846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ea1c-2c91-4bf5-9ff6-9dd41dc05af7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:29.954846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ea1c-2c91-4bf5-9ff6-9dd41dc05af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:29.954846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ea1c-2c91-4bf5-9ff6-9dd41dc05af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:29.955213 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5ea1c-2c91-4bf5-9ff6-9dd41dc05af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:29.956045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5ea1c-2c91-4bf5-9ff6-9dd41dc05af7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:29.968695 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1167/2333] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:29 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:29.976187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.000825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a710-3fe5-46c6-9bd7-dc6ea6a7b895 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.005890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.007059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.007059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.007490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] PATH_INFO: `/v3/projects/177a370134614a068972ecb9ccc604c9/users/b430840a826d4a0bb43e69b1159bfc88/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.049370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177a370134614a068972ecb9ccc604c9, user_id=b430840a826d4a0bb43e69b1159bfc88, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.056823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.083403 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1167/2334] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:29 2021] PUT /identity/v3/projects/177a370134614a068972ecb9ccc604c9/users/b430840a826d4a0bb43e69b1159bfc88/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:30.087192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2245c73-848f-4a8c-8cbe-0b3eada29eb7 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.087575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2245c73-848f-4a8c-8cbe-0b3eada29eb7 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.087852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2245c73-848f-4a8c-8cbe-0b3eada29eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.116522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a2245c73-848f-4a8c-8cbe-0b3eada29eb7 None None] MFA Rules not processed for user `b430840a826d4a0bb43e69b1159bfc88`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:30.117741 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a2245c73-848f-4a8c-8cbe-0b3eada29eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:30.196146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1168/2335] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:30 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:30.200777 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.264147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8ca46-a08d-46b1-b801-c7fc28091073 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.268758 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.269432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.269713 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.269984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.270691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.272672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.305560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1168/2336] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:30 2021] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:30.306791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2245c73-848f-4a8c-8cbe-0b3eada29eb7 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.318330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2245c73-848f-4a8c-8cbe-0b3eada29eb7 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.387125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.388495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.388876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.393206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.394474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.401210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.448514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1169/2337] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:30 2021] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:30.452868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.464856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371c5c3-d401-4d14-9a4a-e30b7860bd3b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.474021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.475133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.475643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.476125 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.477119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.478998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.507794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1169/2338] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:30 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:30.511743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.525799 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337f0cf-afc2-4101-a25d-499a0e6a3d2b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.531211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.532284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.532805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.533519 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] PATH_INFO: `/v3/projects/fe7cf090b641403499d2aba96efaf4e3/users/7caaba8cd9314554a549306ef141477b/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.551766 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cf090b641403499d2aba96efaf4e3, user_id=7caaba8cd9314554a549306ef141477b, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.554940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.576086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1170/2339] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:30 2021] PUT /identity/v3/projects/fe7cf090b641403499d2aba96efaf4e3/users/7caaba8cd9314554a549306ef141477b/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:30.580802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.593755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6d673-fc69-4fbf-88db-47f473bdf5f0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.662738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a761b7-c8f7-4432-8771-32e200871810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.663459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a761b7-c8f7-4432-8771-32e200871810 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.663741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a761b7-c8f7-4432-8771-32e200871810 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.664012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a761b7-c8f7-4432-8771-32e200871810 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.664755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a761b7-c8f7-4432-8771-32e200871810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.666425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a761b7-c8f7-4432-8771-32e200871810 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.678408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1170/2340] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:30 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:30.683441 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.698091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc41c7-7076-47bf-84ed-13f906ca1abb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.704725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.705811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.706186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.706568 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] PATH_INFO: `/v3/projects/fe7cf090b641403499d2aba96efaf4e3/users/7caaba8cd9314554a549306ef141477b/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.709053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cf090b641403499d2aba96efaf4e3, user_id=7caaba8cd9314554a549306ef141477b, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.712121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.724365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1171/2341] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:30 2021] PUT /identity/v3/projects/fe7cf090b641403499d2aba96efaf4e3/users/7caaba8cd9314554a549306ef141477b/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:30.736785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8afb3-7e7f-4233-a3a8-818a5d14a159 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.737152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8afb3-7e7f-4233-a3a8-818a5d14a159 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.737496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8afb3-7e7f-4233-a3a8-818a5d14a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.765844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1fb8afb3-7e7f-4233-a3a8-818a5d14a159 None None] MFA Rules not processed for user `7caaba8cd9314554a549306ef141477b`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:30.767229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1fb8afb3-7e7f-4233-a3a8-818a5d14a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:30.850787 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1171/2342] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:30 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:30.861637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:30.864270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:30.929752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef0da9-8a47-4093-81bf-3d783328f966 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:30.934137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:30.934865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:30.935125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:30.935427 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:30.945708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:30.947051 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:30.957199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1172/2343] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:30 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:31.034517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8afb3-7e7f-4233-a3a8-818a5d14a159 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:31.045792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8afb3-7e7f-4233-a3a8-818a5d14a159 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:31.049805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd509-7723-4e8c-ae1c-234099fddd0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:31.051066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd509-7723-4e8c-ae1c-234099fddd0a service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:31.051391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd509-7723-4e8c-ae1c-234099fddd0a service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:31.051657 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd509-7723-4e8c-ae1c-234099fddd0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:31.123753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd509-7723-4e8c-ae1c-234099fddd0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:31.125539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd509-7723-4e8c-ae1c-234099fddd0a service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:31.135869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1172/2344] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:31 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:31.207451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:31.209279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:31.326944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d4007-3f03-45bd-9022-04c09b9ebc44 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:31.334812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:31.336027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:31.336496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:31.337086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] PATH_INFO: `/v3/users/1575d7b4918d4214bc3da2803471a5ed` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:31.338997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1575d7b4918d4214bc3da2803471a5ed)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:31.342602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:31.408288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1575d7b4918d4214bc3da2803471a5ed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:31.417121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1575d7b4918d4214bc3da2803471a5ed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:31.417962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1575d7b4918d4214bc3da2803471a5ed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:31.433275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1575d7b4918d4214bc3da2803471a5ed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:31.433982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1575d7b4918d4214bc3da2803471a5ed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:31.452838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1173/2345] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:31 2021] DELETE /identity/v3/users/1575d7b4918d4214bc3da2803471a5ed => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:31.454933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:31.455442 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:31.455545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:31.476293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:31.477579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:31.542994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1173/2346] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:31.557245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:31.558900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:31.617121 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8132a-1760-413a-95a1-93f99f629bce admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:31.622675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd43f01-383d-4a0a-81e9-576e433f462f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:31.623486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43f01-383d-4a0a-81e9-576e433f462f service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:31.624619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43f01-383d-4a0a-81e9-576e433f462f service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:31.624903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43f01-383d-4a0a-81e9-576e433f462f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:31.644931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd43f01-383d-4a0a-81e9-576e433f462f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:31.647002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd43f01-383d-4a0a-81e9-576e433f462f service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:31.669678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1174/2347] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:32.054652 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:32.056489 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:32.077104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250059d-3316-47b6-b03d-17e08917ee99 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:32.082168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:32.083135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.083508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.083858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] PATH_INFO: `/v3/projects/332bf1e93a2646ff9cd4865fa2e08690` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.085158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332bf1e93a2646ff9cd4865fa2e08690)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:32.087311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:32.175555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332bf1e93a2646ff9cd4865fa2e08690', 'request_id': 'req-104bb980-382b-4f63-9178-c7bac371b9c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:32.183227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332bf1e93a2646ff9cd4865fa2e08690', 'request_id': 'req-104bb980-382b-4f63-9178-c7bac371b9c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:32.193933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332bf1e93a2646ff9cd4865fa2e08690', 'request_id': 'req-104bb980-382b-4f63-9178-c7bac371b9c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:32.217887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] The token cache is being invalidate because project 332bf1e93a2646ff9cd4865fa2e08690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:32.218199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:32.219784 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-104bb980-382b-4f63-9178-c7bac371b9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:32.222523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1174/2348] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:32 2021] DELETE /identity/v3/projects/332bf1e93a2646ff9cd4865fa2e08690 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:32.227979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43366-ab9f-4c9b-b02b-8d93a3a4e676 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.228532 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43366-ab9f-4c9b-b02b-8d93a3a4e676 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.229058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43366-ab9f-4c9b-b02b-8d93a3a4e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.254208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1ad43366-ab9f-4c9b-b02b-8d93a3a4e676 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:32.256746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1ad43366-ab9f-4c9b-b02b-8d93a3a4e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:32.324417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1175/2349] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:32.333259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fdbe2-ed87-41a4-bf8e-81b9100f942c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.333718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fdbe2-ed87-41a4-bf8e-81b9100f942c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.333967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fdbe2-ed87-41a4-bf8e-81b9100f942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.396328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-028fdbe2-ed87-41a4-bf8e-81b9100f942c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:32.404069 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-028fdbe2-ed87-41a4-bf8e-81b9100f942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:32.429019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1175/2350] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:32.433313 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43366-ab9f-4c9b-b02b-8d93a3a4e676 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:32.445429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43366-ab9f-4c9b-b02b-8d93a3a4e676 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:32.462906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:32.463978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.467416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.467973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.468955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:32.469496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:32.471277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:32.509585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1176/2351] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:34:32.511204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fdbe2-ed87-41a4-bf8e-81b9100f942c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:32.526429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fdbe2-ed87-41a4-bf8e-81b9100f942c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:32.547138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:32.549832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.550144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.550429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.551149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:32.554092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:32.622945 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1176/2352] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:32 2021] POST /identity/v3/projects => generated 397 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:32.627505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:32.639541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aaac3-e0ec-4a4e-856d-cb68002b7eca admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:32.798777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:32.799579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.799934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.800438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.801433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:32.807264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:32.853227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1177/2353] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:32 2021] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:32.858650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:32.875035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f9dc5-11af-4287-b693-de3f632b6400 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:32.889618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd25df-f68f-46c8-817e-739c243ba231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:32.890239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd25df-f68f-46c8-817e-739c243ba231 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.890693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd25df-f68f-46c8-817e-739c243ba231 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.891121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd25df-f68f-46c8-817e-739c243ba231 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.892219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd25df-f68f-46c8-817e-739c243ba231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:32.895111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd25df-f68f-46c8-817e-739c243ba231 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:32.921691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1177/2354] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:32 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:32.923279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:32.935973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e4c3-abf8-4448-bb0b-b99ea91f571c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:32.964511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:32.965387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:32.965841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:32.966068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:32.969890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:32.977717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.010387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.010692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.010984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.023883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1178/2355] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:32 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:33.025081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.053952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adc10a-a81f-4f5a-9f27-d970c26ca094 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.061240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] MFA Rules not processed for user `8b241530f5bd4149a6dca50a1bd023e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:33.063158 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:33.072661 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92ee45-68a2-4e66-a795-e1cc87669d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.073715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ee45-68a2-4e66-a795-e1cc87669d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.073992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ee45-68a2-4e66-a795-e1cc87669d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.074264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92ee45-68a2-4e66-a795-e1cc87669d19 admin admin] PATH_INFO: `/v3/projects/69cd629c94a74662a9c63d1b8ee2a5c6/users/7611856bc47645f2858eb45837b91bd5/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.108005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92ee45-68a2-4e66-a795-e1cc87669d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69cd629c94a74662a9c63d1b8ee2a5c6, user_id=7611856bc47645f2858eb45837b91bd5, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.110435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92ee45-68a2-4e66-a795-e1cc87669d19 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.139020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1179/2356] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:33 2021] PUT /identity/v3/projects/69cd629c94a74662a9c63d1b8ee2a5c6/users/7611856bc47645f2858eb45837b91bd5/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:33.149632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.150102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.150442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.180643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1178/2357] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:33 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:33.185448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] MFA Rules not processed for user `7611856bc47645f2858eb45837b91bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:33.186842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:33.187543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.192886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:33.207397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da89dc-28b9-49d6-9cf0-35f89c3d56a2 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.272145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1180/2358] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:33 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:33.278589 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.279465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.279750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.280100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.280870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.283218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.284200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.285605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:33.319826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1179/2359] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:33 2021] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:33.323441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.428343 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a30bb-3ec2-4243-994e-9458f5c36bde None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.442630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbd30d-995b-494a-bd42-8b169ca3784c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.459619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.460351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.460632 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.460916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.461635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.463635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.497566 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1180/2360] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:33 2021] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:33.502879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.518514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b93fad-c442-4cb3-87d3-92ba68024099 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.525416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.526464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.527072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.527981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.528884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.529719 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.530208 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.530486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.530597 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.532859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.546008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1181/2361] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:33 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:33.554035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.574272 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aef80-4291-4197-a707-95fd1fafd9e0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.580894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.582000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.582517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.582978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] PATH_INFO: `/v3/projects/90a380b1f3c4481cba1e2dbeb03314e8/users/5dcaa808a2524e33a1630185ba8d3ca8/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.602152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a380b1f3c4481cba1e2dbeb03314e8, user_id=5dcaa808a2524e33a1630185ba8d3ca8, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.604877 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.635481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.636958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.644647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1182/2362] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:33 2021] PUT /identity/v3/projects/90a380b1f3c4481cba1e2dbeb03314e8/users/5dcaa808a2524e33a1630185ba8d3ca8/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:33.649745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.657119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1181/2363] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:33 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:34:33.746004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e48b2d-4236-4c5c-8265-9afaa2997a36 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.752609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2333dda-b82b-464b-aeec-e2f7f0296504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.754648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333dda-b82b-464b-aeec-e2f7f0296504 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.754958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333dda-b82b-464b-aeec-e2f7f0296504 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.755238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333dda-b82b-464b-aeec-e2f7f0296504 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.756183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2333dda-b82b-464b-aeec-e2f7f0296504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.757920 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2333dda-b82b-464b-aeec-e2f7f0296504 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.769907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1183/2364] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:33 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:33.774132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:33.791708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57bc33-705b-448a-842b-d8b1fe1b7e3f service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:33.806182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:33.807097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:33.807548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:33.807715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] PATH_INFO: `/v3/projects/90a380b1f3c4481cba1e2dbeb03314e8/users/5dcaa808a2524e33a1630185ba8d3ca8/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:33.810844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a380b1f3c4481cba1e2dbeb03314e8, user_id=5dcaa808a2524e33a1630185ba8d3ca8, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:33.814174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:33.843197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1182/2365] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:33 2021] PUT /identity/v3/projects/90a380b1f3c4481cba1e2dbeb03314e8/users/5dcaa808a2524e33a1630185ba8d3ca8/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:38.927044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb1501-2c40-4571-89ca-d184c2bcab0a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:38.927982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb1501-2c40-4571-89ca-d184c2bcab0a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:38.927982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb1501-2c40-4571-89ca-d184c2bcab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:38.958447 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-42cb1501-2c40-4571-89ca-d184c2bcab0a None None] MFA Rules not processed for user `5dcaa808a2524e33a1630185ba8d3ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:38.959870 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-42cb1501-2c40-4571-89ca-d184c2bcab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:39.037512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1184/2366] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:38 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:39.051387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:39.053570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:39.117281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf3ff-73f2-4813-b3a8-4a158db9f243 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:39.126458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:39.127782 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:39.128061 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:39.128365 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:39.190792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:39.192293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:39.203180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1183/2367] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:39 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:39.320291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fe54-7b55-4e4a-bdae-4eecfb13368f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:39.320504 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fe54-7b55-4e4a-bdae-4eecfb13368f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:39.321104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50fe54-7b55-4e4a-bdae-4eecfb13368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:39.339145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ca50fe54-7b55-4e4a-bdae-4eecfb13368f None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:39.340485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ca50fe54-7b55-4e4a-bdae-4eecfb13368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:39.402132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1185/2368] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:34:39 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:39.451675 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:39.454027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:39.528119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f84b97-d5fd-48ea-b9ec-d75ce6731bcd service glance] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:39.533442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7741be4-ca7f-49ba-8883-5c43f910fe2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:39.534084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741be4-ca7f-49ba-8883-5c43f910fe2d service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:39.534357 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741be4-ca7f-49ba-8883-5c43f910fe2d service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:39.534628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741be4-ca7f-49ba-8883-5c43f910fe2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:39.543058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7741be4-ca7f-49ba-8883-5c43f910fe2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:39.544671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7741be4-ca7f-49ba-8883-5c43f910fe2d service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:39.552995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1184/2369] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:34:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:44.557726 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fe54-7b55-4e4a-bdae-4eecfb13368f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:44.657441 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50fe54-7b55-4e4a-bdae-4eecfb13368f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:44.663891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:44.665722 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:44.666647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:44.667161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] PATH_INFO: `/v3/users/7611856bc47645f2858eb45837b91bd5` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:44.670538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7611856bc47645f2858eb45837b91bd5)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:44.672883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:44.767595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7611856bc47645f2858eb45837b91bd5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:44.784284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7611856bc47645f2858eb45837b91bd5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:44.800095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7611856bc47645f2858eb45837b91bd5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:44.800967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7611856bc47645f2858eb45837b91bd5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:44.818420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7611856bc47645f2858eb45837b91bd5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:44.830790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1186/2370] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:44 2021] DELETE /identity/v3/users/7611856bc47645f2858eb45837b91bd5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:44.832933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:44.833396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:44.833603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:44.842301 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:44.858454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:44.875024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:44.876980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:44.950034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d582ea-77ab-42ce-a73c-4081d19cf40a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:44.959488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1185/2371] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:44.964545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:44.966927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:44.968198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:44.969362 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:44.969744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:44.970116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] PATH_INFO: `/v3/users/b430840a826d4a0bb43e69b1159bfc88` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:44.973116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b430840a826d4a0bb43e69b1159bfc88)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:44.975129 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:45.074188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b430840a826d4a0bb43e69b1159bfc88'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.076745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e543e-3c23-42ff-be07-93e6d13ab9c2 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:45.085492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:45.087412 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:45.087698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:45.088151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:45.092296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b430840a826d4a0bb43e69b1159bfc88'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.099754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b430840a826d4a0bb43e69b1159bfc88'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.100482 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b430840a826d4a0bb43e69b1159bfc88'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.106376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:45.108667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:45.110322 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9a773bde-5b4a-42db-af90-f42f643de700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b430840a826d4a0bb43e69b1159bfc88'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.122269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1187/2372] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:44 2021] DELETE /identity/v3/users/b430840a826d4a0bb43e69b1159bfc88 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:45.124938 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:45.125174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:45.125568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:45.125842 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1186/2373] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:45.146487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:45.147856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:45.232375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1188/2374] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:45.250329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:45.269258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59697605-1ae0-46ea-afca-79b31099ae58 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:45.354387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:45.355215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:45.355854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:45.355854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:45.375975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:45.377398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:45.388248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1187/2375] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:45.557418 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:45.558947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:45.582082 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b444f-c3ab-4858-8fff-352dbeb8be23 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:45.602148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:45.603031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:45.603274 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:45.603613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] PATH_INFO: `/v3/projects/69cd629c94a74662a9c63d1b8ee2a5c6` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:45.604829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69cd629c94a74662a9c63d1b8ee2a5c6)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:45.606881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:45.682186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69cd629c94a74662a9c63d1b8ee2a5c6', 'request_id': 'req-6a431975-c7e7-407c-9d18-0330d841a811'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.694621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69cd629c94a74662a9c63d1b8ee2a5c6', 'request_id': 'req-6a431975-c7e7-407c-9d18-0330d841a811'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.705187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69cd629c94a74662a9c63d1b8ee2a5c6', 'request_id': 'req-6a431975-c7e7-407c-9d18-0330d841a811'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.718536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] The token cache is being invalidate because project 69cd629c94a74662a9c63d1b8ee2a5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:45.718816 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.719528 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:45.721440 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1189/2376] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:45 2021] DELETE /identity/v3/projects/69cd629c94a74662a9c63d1b8ee2a5c6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:45.956118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:45.958159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:45.982119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b3148-0327-4fde-95f4-9e7b175a6f4b service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:46.094400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:46.097904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:46.098197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:46.098410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] PATH_INFO: `/v3/projects/177a370134614a068972ecb9ccc604c9` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:46.099943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177a370134614a068972ecb9ccc604c9)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:46.101931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:46.171840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177a370134614a068972ecb9ccc604c9', 'request_id': 'req-8e01e333-d316-43f8-830c-3abae6d8f490'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.179176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177a370134614a068972ecb9ccc604c9', 'request_id': 'req-8e01e333-d316-43f8-830c-3abae6d8f490'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.185892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177a370134614a068972ecb9ccc604c9', 'request_id': 'req-8e01e333-d316-43f8-830c-3abae6d8f490'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.201374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] The token cache is being invalidate because project 177a370134614a068972ecb9ccc604c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:46.201638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.203865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.205976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1188/2377] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:45 2021] DELETE /identity/v3/projects/177a370134614a068972ecb9ccc604c9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:46.210047 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:46.211498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:46.225247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a431975-c7e7-407c-9d18-0330d841a811 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:46.291928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:46.292826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:46.293105 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:46.293750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] PATH_INFO: `/v3/users/7caaba8cd9314554a549306ef141477b` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:46.294786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caaba8cd9314554a549306ef141477b)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:46.296723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:46.382044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caaba8cd9314554a549306ef141477b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.395990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caaba8cd9314554a549306ef141477b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.405167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caaba8cd9314554a549306ef141477b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.405530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caaba8cd9314554a549306ef141477b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.415377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7ff53a78-2474-45a2-ab79-46f6d16cf21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caaba8cd9314554a549306ef141477b'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.423206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1190/2378] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:46 2021] DELETE /identity/v3/users/7caaba8cd9314554a549306ef141477b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:46.772610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:46.774077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:46.793737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01e333-d316-43f8-830c-3abae6d8f490 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:46.870587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:46.872184 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:46.872669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:46.873007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] PATH_INFO: `/v3/projects/fe7cf090b641403499d2aba96efaf4e3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:46.874803 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7cf090b641403499d2aba96efaf4e3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:46.876797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:46.934378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7cf090b641403499d2aba96efaf4e3', 'request_id': 'req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.941035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7cf090b641403499d2aba96efaf4e3', 'request_id': 'req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.950273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7cf090b641403499d2aba96efaf4e3', 'request_id': 'req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.968591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] The token cache is being invalidate because project fe7cf090b641403499d2aba96efaf4e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:46.970204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.971127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b968ccb8-4267-4dc7-82d3-a5a9c94f8121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:46.974065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1189/2379] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:46 2021] DELETE /identity/v3/projects/fe7cf090b641403499d2aba96efaf4e3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:46.979980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514673fc-110c-4bb1-904d-138c47c79fc5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:46.981011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514673fc-110c-4bb1-904d-138c47c79fc5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:46.981693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514673fc-110c-4bb1-904d-138c47c79fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.007997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-514673fc-110c-4bb1-904d-138c47c79fc5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:47.009553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-514673fc-110c-4bb1-904d-138c47c79fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:47.094473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1191/2380] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:47.103027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7e53c-28fe-41b6-bf2a-08336f6b9bb9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.103165 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7e53c-28fe-41b6-bf2a-08336f6b9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.104194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7e53c-28fe-41b6-bf2a-08336f6b9bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.139725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1eb7e53c-28fe-41b6-bf2a-08336f6b9bb9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:47.141442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1eb7e53c-28fe-41b6-bf2a-08336f6b9bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:47.149670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1190/2381] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:47.154186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514673fc-110c-4bb1-904d-138c47c79fc5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:47.164603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514673fc-110c-4bb1-904d-138c47c79fc5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:47.170765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:47.171922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.172280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.176106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.176962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:47.177588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:47.179217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:47.192748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1192/2382] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:34:47.197672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7e53c-28fe-41b6-bf2a-08336f6b9bb9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:47.207295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7e53c-28fe-41b6-bf2a-08336f6b9bb9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:47.212015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:47.212680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.212961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.213237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.213930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:47.216073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:47.251862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1191/2383] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:47 2021] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:47.256314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:47.267088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764463cc-8e7f-4a7b-bfda-d851c0f02817 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:47.349086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:47.349928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.350211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.350484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.351189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:47.353164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:47.383476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1193/2384] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:47 2021] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:47.385534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:47.396209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d509bbf-a2ca-4ad7-abd6-650c370bcbb1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:47.404683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:47.405736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.406014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.406286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.407024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:47.408668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:47.423384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1192/2385] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:47 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:47.427630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:47.438718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24bd4-433a-4201-bbe6-ac1e6bf7430b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:47.443080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a0bb2-7d65-487b-bba8-715560f5b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:47.443814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0bb2-7d65-487b-bba8-715560f5b926 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.444164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0bb2-7d65-487b-bba8-715560f5b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.444505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0bb2-7d65-487b-bba8-715560f5b926 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.445331 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a0bb2-7d65-487b-bba8-715560f5b926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:47.447593 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a0bb2-7d65-487b-bba8-715560f5b926 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:47.461503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1194/2386] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:47.463613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:47.476657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed3ca2-ca0f-46e1-92c0-6858dd5c5334 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:47.483066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:47.486639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.487148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.487764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] PATH_INFO: `/v3/projects/8353e0774ad54027a77368ff63aaf250/users/b9443bd2d0cc4656957804e943fc92ac/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.511202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8353e0774ad54027a77368ff63aaf250, user_id=b9443bd2d0cc4656957804e943fc92ac, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:47.514628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:47.534475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1193/2387] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:47 2021] PUT /identity/v3/projects/8353e0774ad54027a77368ff63aaf250/users/b9443bd2d0cc4656957804e943fc92ac/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:47.546042 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d3f80-3682-4c65-ae38-c3e567507337 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.546328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d3f80-3682-4c65-ae38-c3e567507337 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.546613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d3f80-3682-4c65-ae38-c3e567507337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.574876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3f2d3f80-3682-4c65-ae38-c3e567507337 None None] MFA Rules not processed for user `b9443bd2d0cc4656957804e943fc92ac`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:47.576085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3f2d3f80-3682-4c65-ae38-c3e567507337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:47.649448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1195/2388] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:47 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:47.659599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:47.661336 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:47.731596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b10de-ce5a-4ab1-b32f-f88df552b1d3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:47.737760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67397d85-ce23-4e16-974b-8ea434f03aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:47.738595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397d85-ce23-4e16-974b-8ea434f03aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:47.738975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397d85-ce23-4e16-974b-8ea434f03aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:47.739401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397d85-ce23-4e16-974b-8ea434f03aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:47.749438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67397d85-ce23-4e16-974b-8ea434f03aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:47.753337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67397d85-ce23-4e16-974b-8ea434f03aa5 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:47.764967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1194/2389] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:47 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:34:50.122171 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:50.122694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:50.122811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:50.141759 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] MFA Rules not processed for user `8b241530f5bd4149a6dca50a1bd023e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:50.143015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:50.200907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1196/2390] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:50 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:53.425004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c551-49f9-4fb0-a0fc-d2f92861dcb9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:53.425483 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c551-49f9-4fb0-a0fc-d2f92861dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:53.425600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c551-49f9-4fb0-a0fc-d2f92861dcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:53.444073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ebe6c551-49f9-4fb0-a0fc-d2f92861dcb9 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:53.445281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ebe6c551-49f9-4fb0-a0fc-d2f92861dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:53.504907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1195/2391] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:34:53 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:53.518635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:53.520298 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:53.596808 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccf730-7d8a-46aa-bdf2-35721750415c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:53.602427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7d6b3-44d1-4203-ab29-878ff3cc9196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:53.603091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d6b3-44d1-4203-ab29-878ff3cc9196 service swift] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:53.603393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d6b3-44d1-4203-ab29-878ff3cc9196 service swift] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:53.603674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7d6b3-44d1-4203-ab29-878ff3cc9196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:53.613858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7d6b3-44d1-4203-ab29-878ff3cc9196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:53.615643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7d6b3-44d1-4203-ab29-878ff3cc9196 service swift] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:53.624634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1197/2392] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:34:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:56.764156 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6c551-49f9-4fb0-a0fc-d2f92861dcb9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:56.861869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6c551-49f9-4fb0-a0fc-d2f92861dcb9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:56.871470 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:56.872904 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:56.873372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:56.873837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] PATH_INFO: `/v3/users/b9443bd2d0cc4656957804e943fc92ac` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:56.876041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9443bd2d0cc4656957804e943fc92ac)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:56.879447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:56.954917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9443bd2d0cc4656957804e943fc92ac'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:56.962721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9443bd2d0cc4656957804e943fc92ac'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:56.963498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9443bd2d0cc4656957804e943fc92ac'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:56.977128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9443bd2d0cc4656957804e943fc92ac'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:56.977885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9443bd2d0cc4656957804e943fc92ac'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:56.992997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1196/2393] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:34:56 2021] DELETE /identity/v3/users/b9443bd2d0cc4656957804e943fc92ac => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:56.997744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:56.998313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:56.998313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.016353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:57.017636 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:57.090497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1198/2394] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:34:57.101021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:57.102490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:57.163370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5cbc-51e6-4c97-a7cd-b0f00a610f67 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:57.167045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aa0fb-218b-4647-b76f-0ab7126581fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:57.167734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aa0fb-218b-4647-b76f-0ab7126581fe service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.168077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aa0fb-218b-4647-b76f-0ab7126581fe service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.168357 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aa0fb-218b-4647-b76f-0ab7126581fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.195960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aa0fb-218b-4647-b76f-0ab7126581fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:57.197676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aa0fb-218b-4647-b76f-0ab7126581fe service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:57.208297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1197/2395] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:34:57.508544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:57.510009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:57.521808 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0788-6bd0-431a-9e33-13e3bf67e68a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:57.526449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:57.527606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.527938 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.528251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] PATH_INFO: `/v3/projects/8353e0774ad54027a77368ff63aaf250` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.529488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8353e0774ad54027a77368ff63aaf250)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:57.531413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:57.582144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8353e0774ad54027a77368ff63aaf250', 'request_id': 'req-ae06df37-c507-4a70-aa56-01d5e63a85ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:57.589448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8353e0774ad54027a77368ff63aaf250', 'request_id': 'req-ae06df37-c507-4a70-aa56-01d5e63a85ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:57.599106 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8353e0774ad54027a77368ff63aaf250', 'request_id': 'req-ae06df37-c507-4a70-aa56-01d5e63a85ce'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:57.609990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] The token cache is being invalidate because project 8353e0774ad54027a77368ff63aaf250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:34:57.610305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:57.610941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ae06df37-c507-4a70-aa56-01d5e63a85ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:34:57.612529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1199/2396] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:34:57 2021] DELETE /identity/v3/projects/8353e0774ad54027a77368ff63aaf250 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:57.618437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56053b2-064f-45d7-a19a-146022d31936 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.618753 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56053b2-064f-45d7-a19a-146022d31936 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.619055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56053b2-064f-45d7-a19a-146022d31936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.637094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c56053b2-064f-45d7-a19a-146022d31936 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:57.638294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c56053b2-064f-45d7-a19a-146022d31936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:57.703246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1198/2397] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:57.711312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02f4d-f935-4077-86e8-88002b7817e7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.711645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02f4d-f935-4077-86e8-88002b7817e7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.711924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a02f4d-f935-4077-86e8-88002b7817e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.730329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-75a02f4d-f935-4077-86e8-88002b7817e7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:57.731577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-75a02f4d-f935-4077-86e8-88002b7817e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:57.739700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1200/2398] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:57.743984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56053b2-064f-45d7-a19a-146022d31936 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:57.755119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56053b2-064f-45d7-a19a-146022d31936 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:57.761505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:57.762459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.762721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.763021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.763778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:34:57.764087 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:57.765710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:57.791629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1199/2399] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:34:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:34:57.795083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a02f4d-f935-4077-86e8-88002b7817e7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:57.805056 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a02f4d-f935-4077-86e8-88002b7817e7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:57.810663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:57.811313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.811623 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.811900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.812603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:57.814513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:57.849922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1201/2400] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:57 2021] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:57.854732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:57.872376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef06e26-4aa5-4c4f-bb7c-74f48645e0bd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:57.944032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:57.944701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.944984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.945256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.945926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:57.948016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:57.971506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1200/2401] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:57 2021] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:57.978765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:57.991052 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22f457-34b8-476e-a08c-d1aac2ddd2fa admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:57.997320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:57.998021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:57.998611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:57.998611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:57.999305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.001229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.013795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1202/2402] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:57 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:58.017992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.028590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadaca0-5d0d-44b8-b802-e66861d8d5b8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.033717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdea1d-5293-4c8a-84b4-a6063415f195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.034402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdea1d-5293-4c8a-84b4-a6063415f195 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.034712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdea1d-5293-4c8a-84b4-a6063415f195 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.034980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdea1d-5293-4c8a-84b4-a6063415f195 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.035810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdea1d-5293-4c8a-84b4-a6063415f195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.037566 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdea1d-5293-4c8a-84b4-a6063415f195 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.048544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1201/2403] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:34:58.052917 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.064159 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ff539-2a0d-4ab3-b049-2eeaf9133e2e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.075768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.076790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.077145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.077491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] PATH_INFO: `/v3/projects/d4353c05368b428aa4f7b1c0180b7ed9/users/6e75700aa64942daa8a6ffa6c304cb00/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.108450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4353c05368b428aa4f7b1c0180b7ed9, user_id=6e75700aa64942daa8a6ffa6c304cb00, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.111049 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.126319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1203/2404] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:58 2021] PUT /identity/v3/projects/d4353c05368b428aa4f7b1c0180b7ed9/users/6e75700aa64942daa8a6ffa6c304cb00/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:58.136536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d7821-8143-48de-9874-a1794f5b7d10 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.136712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d7821-8143-48de-9874-a1794f5b7d10 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.137028 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d7821-8143-48de-9874-a1794f5b7d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.164699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a97d7821-8143-48de-9874-a1794f5b7d10 None None] MFA Rules not processed for user `6e75700aa64942daa8a6ffa6c304cb00`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:58.165911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a97d7821-8143-48de-9874-a1794f5b7d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:58.248088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1202/2405] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:58 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:58.252771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.327161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4fca3-1ee8-42e1-9554-cf7d2ae80357 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.332277 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.333036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.333391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.333666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.334700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.336793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.366428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1204/2406] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:58 2021] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:58.375100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d7821-8143-48de-9874-a1794f5b7d10 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.392549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d7821-8143-48de-9874-a1794f5b7d10 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.455872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.456659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.457044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.457328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.458025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.460021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.480231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1203/2407] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:58 2021] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:58.484289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.494762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bf542-97df-48ea-af45-9f89b0c71771 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.499670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.500338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.500622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.500902 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.501637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.503237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.514645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1205/2408] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:58.519008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.531252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af69adb-adf5-460c-8375-47eed1d5b104 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.536749 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1406f98-f469-4140-94e1-ffcc43f70550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.537472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406f98-f469-4140-94e1-ffcc43f70550 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.537754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406f98-f469-4140-94e1-ffcc43f70550 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.538032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406f98-f469-4140-94e1-ffcc43f70550 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.538773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1406f98-f469-4140-94e1-ffcc43f70550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.540449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1406f98-f469-4140-94e1-ffcc43f70550 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.558129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1204/2409] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:58.558791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.569742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab057e-6d9e-411e-8fe4-fcd4ecf4ee9b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.575552 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.576542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.576855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.577131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] PATH_INFO: `/v3/projects/255fd7dcd5ca47e389135fccb23b5b44/users/e696289691964264aafe32685787ea73/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.592591 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255fd7dcd5ca47e389135fccb23b5b44, user_id=e696289691964264aafe32685787ea73, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.595246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.609169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1206/2410] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:58 2021] PUT /identity/v3/projects/255fd7dcd5ca47e389135fccb23b5b44/users/e696289691964264aafe32685787ea73/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:58.620626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c27ef-c610-4c7e-83b3-72127d705988 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.620856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c27ef-c610-4c7e-83b3-72127d705988 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.621308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c27ef-c610-4c7e-83b3-72127d705988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.653065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-019c27ef-c610-4c7e-83b3-72127d705988 None None] MFA Rules not processed for user `e696289691964264aafe32685787ea73`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:58.654494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-019c27ef-c610-4c7e-83b3-72127d705988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:58.723172 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1205/2411] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:58 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:58.727991 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.796562 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777b36e-82ed-48dc-97eb-151138a4a496 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.801215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.802182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.802465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.802733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.803464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.805362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.831027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1207/2412] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:34:58 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:34:58.835550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c27ef-c610-4c7e-83b3-72127d705988 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.848391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c27ef-c610-4c7e-83b3-72127d705988 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.921010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.921687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.921966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.922239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.922933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.924898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.946324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1206/2413] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:34:58 2021] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:34:58.952446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:58.967496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcffa50-0f2b-4f91-bf8e-a8e44bb817a2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:58.974134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:58.974840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:58.975110 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:58.975414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:58.976191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:58.978521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:58.993548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1208/2414] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:58.997883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:59.009013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fa6a-4ee9-4620-b561-91cef5b8e9c4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:59.014872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:59.016037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:59.016443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:59.016825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] PATH_INFO: `/v3/projects/094ed3d27ad142a4a192082ac00316be/users/9434ba2727034e708bf172d8a2dd1771/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:59.033425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094ed3d27ad142a4a192082ac00316be, user_id=9434ba2727034e708bf172d8a2dd1771, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:59.036143 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:59.050390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1207/2415] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:58 2021] PUT /identity/v3/projects/094ed3d27ad142a4a192082ac00316be/users/9434ba2727034e708bf172d8a2dd1771/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:34:59.054832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:59.065928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396e06-b491-43af-a071-5ea88cbbf3e6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:59.125186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7b71f-be01-4a93-b236-a5a07fdf90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:59.125859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b71f-be01-4a93-b236-a5a07fdf90b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:59.126138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b71f-be01-4a93-b236-a5a07fdf90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:59.126409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b71f-be01-4a93-b236-a5a07fdf90b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:59.127134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b71f-be01-4a93-b236-a5a07fdf90b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:59.128851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b71f-be01-4a93-b236-a5a07fdf90b3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:59.139926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1209/2416] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:34:59.145600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:59.156433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f2b7a-e2fc-4891-a58f-44f096898176 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:59.161354 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:59.162232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:59.162508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:59.162781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] PATH_INFO: `/v3/projects/094ed3d27ad142a4a192082ac00316be/users/9434ba2727034e708bf172d8a2dd1771/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:59.164967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094ed3d27ad142a4a192082ac00316be, user_id=9434ba2727034e708bf172d8a2dd1771, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:59.170228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:59.192319 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1208/2417] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:34:59 2021] PUT /identity/v3/projects/094ed3d27ad142a4a192082ac00316be/users/9434ba2727034e708bf172d8a2dd1771/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:34:59.193924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8dd3-1814-47c2-91da-33f5322a59cc None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:59.194211 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8dd3-1814-47c2-91da-33f5322a59cc None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:59.194490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8dd3-1814-47c2-91da-33f5322a59cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:59.230295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-af1d8dd3-1814-47c2-91da-33f5322a59cc None None] MFA Rules not processed for user `9434ba2727034e708bf172d8a2dd1771`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:34:59.231565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-af1d8dd3-1814-47c2-91da-33f5322a59cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:59.330660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1210/2418] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:34:59 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:34:59.342902 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:34:59.344895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:34:59.405789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0800d9-8efd-4640-aec0-94312538da35 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:34:59.411951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:34:59.412623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:34:59.412906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:34:59.413231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:34:59.520627 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:34:59.522270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:34:59.536302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1209/2419] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:34:59 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:01.090399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8dd3-1814-47c2-91da-33f5322a59cc None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:01.103111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8dd3-1814-47c2-91da-33f5322a59cc None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:01.108996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:01.109921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:01.110384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:01.111894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:01.116285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:01.142617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:01.144254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:01.157828 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba6ae-f816-41c0-8d07-bc3823f2f501 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:01.163576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:01.164710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:01.165239 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:01.165732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:01.191191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:01.193085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:01.215739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1211/2420] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:01.252098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:01.253591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:01.263042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1210/2421] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:35:01.961259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:01.981234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaff388-d47b-47e3-aaec-77166fd9293d service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:01.991396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:01.991396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:01.991396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:01.991396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:01.999597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:02.001137 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:02.011491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1212/2422] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:01 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:04.905628 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:04.907632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:04.966499 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ab87c-1aa5-4070-a587-28ccc775180d service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:04.970077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc005d-5eb2-42bb-aaa6-5d8b0a79f96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:04.970723 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc005d-5eb2-42bb-aaa6-5d8b0a79f96a service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:04.971001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc005d-5eb2-42bb-aaa6-5d8b0a79f96a service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:04.971275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc005d-5eb2-42bb-aaa6-5d8b0a79f96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:04.973037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-96dc005d-5eb2-42bb-aaa6-5d8b0a79f96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:04.982432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc005d-5eb2-42bb-aaa6-5d8b0a79f96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:04.983908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc005d-5eb2-42bb-aaa6-5d8b0a79f96a service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:04.991688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1211/2423] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:04 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:06.012880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:06.092165 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af6e3-a679-4f1c-b2cf-f0420755e8e4 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:06.096693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:06.097642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:06.097983 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:06.098299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] PATH_INFO: `/v3/users/6e75700aa64942daa8a6ffa6c304cb00` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:06.099600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e75700aa64942daa8a6ffa6c304cb00)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:06.101569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:06.147544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e75700aa64942daa8a6ffa6c304cb00'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.161906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e75700aa64942daa8a6ffa6c304cb00'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.170104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e75700aa64942daa8a6ffa6c304cb00'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.170881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e75700aa64942daa8a6ffa6c304cb00'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.179542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e75700aa64942daa8a6ffa6c304cb00'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.186581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1213/2424] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:35:06 2021] DELETE /identity/v3/users/6e75700aa64942daa8a6ffa6c304cb00 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:06.191262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:06.191802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:06.191903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:06.211422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:06.213043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:06.247401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:06.249018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:06.309251 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1212/2425] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:06.320681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:06.322139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:06.345317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e18f17-164d-44fb-aaac-935d4030b564 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:06.353433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:06.354189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:06.354554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:06.354898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:06.357686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:06.372830 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:06.374748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:06.387054 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1214/2426] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:35:06.398305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ccbd7-56bf-48d5-9157-fd9d179f53d0 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:06.402235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:06.402983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:06.403337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:06.403720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:06.416170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:06.417768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:06.431607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1213/2427] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:06.740936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:06.742484 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:06.763525 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638f1a0-d393-416f-91dd-89a62570595e service nova] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:06.770486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:06.771725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:06.772097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:06.772470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] PATH_INFO: `/v3/projects/d4353c05368b428aa4f7b1c0180b7ed9` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:06.773880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4353c05368b428aa4f7b1c0180b7ed9)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:06.776145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:06.824811 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4353c05368b428aa4f7b1c0180b7ed9', 'request_id': 'req-9bab7c1f-5289-40e4-aaff-922c5050a912'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.830788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4353c05368b428aa4f7b1c0180b7ed9', 'request_id': 'req-9bab7c1f-5289-40e4-aaff-922c5050a912'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.839802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4353c05368b428aa4f7b1c0180b7ed9', 'request_id': 'req-9bab7c1f-5289-40e4-aaff-922c5050a912'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.851405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] The token cache is being invalidate because project d4353c05368b428aa4f7b1c0180b7ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:35:06.851702 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.852367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:06.853959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1215/2428] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:35:06 2021] DELETE /identity/v3/projects/d4353c05368b428aa4f7b1c0180b7ed9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:06.858357 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:06.868408 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee2fc-fb41-49db-87de-67e492fe2c97 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:06.942234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:06.943212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:06.943587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:06.944014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] PATH_INFO: `/v3/users/e696289691964264aafe32685787ea73` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:06.947182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e696289691964264aafe32685787ea73)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:06.950720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:07.016722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e696289691964264aafe32685787ea73'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.023814 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e696289691964264aafe32685787ea73'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.024573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e696289691964264aafe32685787ea73'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.036763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e696289691964264aafe32685787ea73'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.037405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e696289691964264aafe32685787ea73'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.051098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1214/2429] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:35:06 2021] DELETE /identity/v3/users/e696289691964264aafe32685787ea73 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:35:07.381530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:07.383233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:07.415526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7c1f-5289-40e4-aaff-922c5050a912 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:07.479202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:07.480228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:07.480648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:07.480922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] PATH_INFO: `/v3/projects/255fd7dcd5ca47e389135fccb23b5b44` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:07.482724 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=255fd7dcd5ca47e389135fccb23b5b44)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:07.484705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:07.537316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255fd7dcd5ca47e389135fccb23b5b44', 'request_id': 'req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.544057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255fd7dcd5ca47e389135fccb23b5b44', 'request_id': 'req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.553368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255fd7dcd5ca47e389135fccb23b5b44', 'request_id': 'req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.564232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] The token cache is being invalidate because project 255fd7dcd5ca47e389135fccb23b5b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:35:07.564521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.565164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.566756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1216/2430] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:35:07 2021] DELETE /identity/v3/projects/255fd7dcd5ca47e389135fccb23b5b44 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:07.571201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:07.572775 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:07.586314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bbdfd-4574-4da5-9d09-d5cdf8f048a0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:07.648887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:07.649686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:07.650020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:07.650273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] PATH_INFO: `/v3/users/9434ba2727034e708bf172d8a2dd1771` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:07.651589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9434ba2727034e708bf172d8a2dd1771)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:07.653588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:07.707495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9434ba2727034e708bf172d8a2dd1771'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.714947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9434ba2727034e708bf172d8a2dd1771'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.715689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9434ba2727034e708bf172d8a2dd1771'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.728258 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9434ba2727034e708bf172d8a2dd1771'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.729029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-af0a141c-1dab-4636-bb88-1dd8a595abc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9434ba2727034e708bf172d8a2dd1771'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:07.743400 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1215/2431] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:35:07 2021] DELETE /identity/v3/users/9434ba2727034e708bf172d8a2dd1771 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:35:08.049197 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:08.051426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:08.084100 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a57e0-00e9-4b95-9d5b-e5b49fb347b3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:08.147003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:08.148008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.148228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.148613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] PATH_INFO: `/v3/projects/094ed3d27ad142a4a192082ac00316be` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.150146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094ed3d27ad142a4a192082ac00316be)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:08.152612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:08.211536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094ed3d27ad142a4a192082ac00316be', 'request_id': 'req-4627a4e5-13d4-4e12-a152-f0edee286f84'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:08.218029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094ed3d27ad142a4a192082ac00316be', 'request_id': 'req-4627a4e5-13d4-4e12-a152-f0edee286f84'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:08.225941 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094ed3d27ad142a4a192082ac00316be', 'request_id': 'req-4627a4e5-13d4-4e12-a152-f0edee286f84'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:08.236516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] The token cache is being invalidate because project 094ed3d27ad142a4a192082ac00316be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:35:08.236921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:08.237633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-4627a4e5-13d4-4e12-a152-f0edee286f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:08.239257 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1217/2432] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:35:08 2021] DELETE /identity/v3/projects/094ed3d27ad142a4a192082ac00316be => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:08.245879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec41e3-42b2-4e0f-8ba0-31442a5370b1 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.246320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec41e3-42b2-4e0f-8ba0-31442a5370b1 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.246536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec41e3-42b2-4e0f-8ba0-31442a5370b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.267752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-18ec41e3-42b2-4e0f-8ba0-31442a5370b1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:08.268988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-18ec41e3-42b2-4e0f-8ba0-31442a5370b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:08.380289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc9e8-097d-4376-bca2-1b4ada09736b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.383093 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc9e8-097d-4376-bca2-1b4ada09736b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.384876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc9e8-097d-4376-bca2-1b4ada09736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.412312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1f6bc9e8-097d-4376-bca2-1b4ada09736b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:08.413743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1f6bc9e8-097d-4376-bca2-1b4ada09736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:08.421375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1216/2433] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:08.430660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1218/2434] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:08.431481 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec41e3-42b2-4e0f-8ba0-31442a5370b1 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:08.447964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec41e3-42b2-4e0f-8ba0-31442a5370b1 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:08.455936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:08.456674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.456897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.457171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.457907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:35:08.458214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:08.459853 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:08.502955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1217/2435] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:35:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:35:08.506943 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc9e8-097d-4376-bca2-1b4ada09736b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:08.533507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc9e8-097d-4376-bca2-1b4ada09736b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:08.559202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:08.559898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.560178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.560450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.561280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:08.568151 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:08.619109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1219/2436] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:35:08 2021] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:35:08.624193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:08.639751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa18cb-6914-4047-bc66-2a66df58d278 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:08.702509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:08.703175 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.703489 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.703787 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.704503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:08.706407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:08.731721 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1218/2437] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:35:08 2021] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:35:08.733016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:08.743662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae11a22-e527-4471-a149-eb7c9c182cd7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:08.748916 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:08.749817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.750208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.750704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.751539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:08.753209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:08.764671 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1220/2438] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:35:08.768459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:08.781440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e97e4-527f-43a4-9a64-a2ed9adf4d4a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:08.786461 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a004622-9e52-4114-a3e7-f3b575812242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:08.787129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004622-9e52-4114-a3e7-f3b575812242 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.787438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004622-9e52-4114-a3e7-f3b575812242 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.787713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004622-9e52-4114-a3e7-f3b575812242 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.788443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a004622-9e52-4114-a3e7-f3b575812242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:08.790057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a004622-9e52-4114-a3e7-f3b575812242 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:08.802298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1219/2439] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:08 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:35:08.806850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:08.821656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3ec5-a5e6-4460-b6c3-2e470cb73503 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:08.826663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:08.835150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.835468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.835756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] PATH_INFO: `/v3/projects/0ca77960403e4d3889a0f5d3308ef34e/users/7b4979e169be415cab562b155f5f5adf/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.851887 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca77960403e4d3889a0f5d3308ef34e, user_id=7b4979e169be415cab562b155f5f5adf, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:08.854598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:08.872751 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1221/2440] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:35:08 2021] PUT /identity/v3/projects/0ca77960403e4d3889a0f5d3308ef34e/users/7b4979e169be415cab562b155f5f5adf/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:08.883065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef337ec-a186-4c73-893d-aa5ffd6d40e7 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:08.883413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef337ec-a186-4c73-893d-aa5ffd6d40e7 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:08.883657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef337ec-a186-4c73-893d-aa5ffd6d40e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:08.925506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-4ef337ec-a186-4c73-893d-aa5ffd6d40e7 None None] MFA Rules not processed for user `7b4979e169be415cab562b155f5f5adf`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:08.927584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4ef337ec-a186-4c73-893d-aa5ffd6d40e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:09.040530 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1220/2441] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:08 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:09.041301 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:09.131953 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcecdc8-b893-4ef6-8896-8e48ebfb9e39 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:09.138341 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:09.139132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.139505 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.139860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.140582 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:09.142517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:09.185648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1222/2442] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:35:09 2021] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:35:09.189800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef337ec-a186-4c73-893d-aa5ffd6d40e7 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:09.205110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef337ec-a186-4c73-893d-aa5ffd6d40e7 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:09.269242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:09.271144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.271622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.272233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.273076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:09.276305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:09.303426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1221/2443] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:35:09 2021] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:35:09.307164 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:09.323543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82432048-cc26-48a1-ba2c-d31ac3385f7b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:09.330655 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:09.332058 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.332841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.333343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.334822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:09.337172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:09.351207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1223/2444] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:09 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:35:09.355751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:09.367503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c897bc7-91b7-44de-be1d-52c1551c7532 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:09.382192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006e6f1-e222-4e1f-8003-0fa443dc9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:09.382885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006e6f1-e222-4e1f-8003-0fa443dc9197 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.383253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006e6f1-e222-4e1f-8003-0fa443dc9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.383550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006e6f1-e222-4e1f-8003-0fa443dc9197 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.384363 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006e6f1-e222-4e1f-8003-0fa443dc9197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:09.386049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006e6f1-e222-4e1f-8003-0fa443dc9197 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:09.398376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1222/2445] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:09 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:35:09.403561 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:09.416783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38f067-5dcf-4e97-a925-20cc31983c06 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:09.427324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:09.428333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.428561 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.428838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] PATH_INFO: `/v3/projects/f39c0b8713394cb0a938d61753fc2095/users/3e5d759f685b447a9a68489ace3dd8bb/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.445526 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39c0b8713394cb0a938d61753fc2095, user_id=3e5d759f685b447a9a68489ace3dd8bb, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:09.448229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:09.472810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1224/2446] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:35:09 2021] PUT /identity/v3/projects/f39c0b8713394cb0a938d61753fc2095/users/3e5d759f685b447a9a68489ace3dd8bb/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:09.483293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dd0b0-165e-4bfd-8f6e-bca05d6c0007 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.483571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dd0b0-165e-4bfd-8f6e-bca05d6c0007 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.483825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dd0b0-165e-4bfd-8f6e-bca05d6c0007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.550340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-e24dd0b0-165e-4bfd-8f6e-bca05d6c0007 None None] MFA Rules not processed for user `3e5d759f685b447a9a68489ace3dd8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:09.553176 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e24dd0b0-165e-4bfd-8f6e-bca05d6c0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:09.665760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1223/2447] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:09 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:09.666672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:09.840788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83993cd-cacd-4c1d-b9f2-d4d21ab987f1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:09.846998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:09.847694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.848160 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.848433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.849181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:09.851296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:09.886014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1225/2448] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:35:09 2021] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:35:09.887636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dd0b0-165e-4bfd-8f6e-bca05d6c0007 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:09.899823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dd0b0-165e-4bfd-8f6e-bca05d6c0007 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:09.962916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:09.964019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:09.964574 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:09.965078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:09.966102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:09.968428 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:09.999634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1224/2449] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:35:09 2021] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:35:10.001923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:10.015081 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fb33e-e7b1-4573-aa5f-09f80cfb47ad admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:10.027060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:10.028291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:10.028815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:10.029152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:10.030186 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:10.031857 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:10.043660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1226/2450] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:10 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:35:10.050805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:10.066025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae975e-6323-451f-9dbd-8315f0cee424 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:10.073753 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:10.075128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:10.075513 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:10.075943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] PATH_INFO: `/v3/projects/18c7ef81199e4e93b9795e3066a39088/users/b5dbe7ef0e054a22bc7e8836ae4ca56f/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:10.095790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c7ef81199e4e93b9795e3066a39088, user_id=b5dbe7ef0e054a22bc7e8836ae4ca56f, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:10.099538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:10.115873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1225/2451] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:35:10 2021] PUT /identity/v3/projects/18c7ef81199e4e93b9795e3066a39088/users/b5dbe7ef0e054a22bc7e8836ae4ca56f/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:10.119523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:10.130707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00917be5-7c19-484a-b4d2-a1f234bd3f5b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:10.198108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb687-1c8e-4434-90ce-41f6d00ab77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:10.199199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb687-1c8e-4434-90ce-41f6d00ab77b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:10.199821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb687-1c8e-4434-90ce-41f6d00ab77b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:10.199926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb687-1c8e-4434-90ce-41f6d00ab77b admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:10.200890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb687-1c8e-4434-90ce-41f6d00ab77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:10.203170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb687-1c8e-4434-90ce-41f6d00ab77b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:10.220885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1227/2452] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:10 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:35:10.222283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:10.236705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbed7f1-4f16-4693-8851-63665af0915e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:10.255378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:10.256942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:10.256942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:10.260411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] PATH_INFO: `/v3/projects/18c7ef81199e4e93b9795e3066a39088/users/b5dbe7ef0e054a22bc7e8836ae4ca56f/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:10.263876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c7ef81199e4e93b9795e3066a39088, user_id=b5dbe7ef0e054a22bc7e8836ae4ca56f, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:10.266754 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:10.281545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1226/2453] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:35:10 2021] PUT /identity/v3/projects/18c7ef81199e4e93b9795e3066a39088/users/b5dbe7ef0e054a22bc7e8836ae4ca56f/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:10.292624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18295ec9-99a2-408f-a8c0-72fd1189d988 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:10.293118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18295ec9-99a2-408f-a8c0-72fd1189d988 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:10.293632 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18295ec9-99a2-408f-a8c0-72fd1189d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:10.322114 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-18295ec9-99a2-408f-a8c0-72fd1189d988 None None] MFA Rules not processed for user `b5dbe7ef0e054a22bc7e8836ae4ca56f`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:10.323492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-18295ec9-99a2-408f-a8c0-72fd1189d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:10.423217 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1228/2454] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:10 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:10.434107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:10.435873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:10.491954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce4d76-5867-4df7-ba69-767214da0008 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:10.495817 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:10.496465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:10.496737 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:10.497006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:10.553571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:10.555052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:10.564472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1227/2455] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:10 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:12.022854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:12.023387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:12.023493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:12.041630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] MFA Rules not processed for user `5c8979c080c54e9096de897a22ba40b3`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:12.043512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:12.101349 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1229/2456] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:12 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:12.106905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:12.108469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:12.119844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e27056-c982-43b3-a8dd-e3b9920bd101 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:12.123809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:12.124527 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:12.124877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:12.125217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:12.185722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:12.187170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:12.196432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1228/2457] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:12 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:12.460422 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:12.462212 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:12.529527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50935bdc-dc19-48b7-bc25-a08c08e5fa8d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:12.533432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:12.534446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:12.534727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:12.535002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:12.537141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:12.547050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:12.548529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:12.557715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1230/2458] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:12.754087 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:12.763741 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb478-5a7b-473b-a7cc-926f613e7041 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:12.768357 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:12.769193 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:12.769573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:12.769950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:12.780319 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:12.781918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:12.791882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1229/2459] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:12 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:13.662969 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:13.664612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:13.744213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18cb5-a86f-49c8-b613-e62d1d4d9ba6 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:13.750905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a24f4-df42-4176-ac59-2d7bc749bc39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:13.751612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a24f4-df42-4176-ac59-2d7bc749bc39 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:13.751891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a24f4-df42-4176-ac59-2d7bc749bc39 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:13.752170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a24f4-df42-4176-ac59-2d7bc749bc39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:13.754084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-804a24f4-df42-4176-ac59-2d7bc749bc39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:13.767138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a24f4-df42-4176-ac59-2d7bc749bc39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:13.768934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a24f4-df42-4176-ac59-2d7bc749bc39 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:13.779919 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1231/2460] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:16.793036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:16.864810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a332c65-bae5-4724-bb62-e900d8902ff3 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:16.871547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:16.872905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:16.873293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:16.873717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] PATH_INFO: `/v3/users/7b4979e169be415cab562b155f5f5adf` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:16.875316 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4979e169be415cab562b155f5f5adf)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:16.878504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:16.929503 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4979e169be415cab562b155f5f5adf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:16.936852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4979e169be415cab562b155f5f5adf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:16.937569 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4979e169be415cab562b155f5f5adf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:16.950339 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4979e169be415cab562b155f5f5adf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:16.951084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4979e169be415cab562b155f5f5adf'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:16.967802 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1230/2461] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:35:16 2021] DELETE /identity/v3/users/7b4979e169be415cab562b155f5f5adf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:16.972649 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:16.973152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:16.973380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:16.995145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:16.996512 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:17.061036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1232/2462] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:17.071713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:17.073286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:17.133279 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474b088-f0ce-4339-beac-343b6d268bc2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:17.137352 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:17.138003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:17.138284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:17.138561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:17.148835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:17.150297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:17.162435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1231/2463] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:17.488970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:17.490619 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:17.506111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193fa38-a019-4eff-917e-bd5574b20036 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:17.517359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:17.518312 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:17.518747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:17.519017 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] PATH_INFO: `/v3/projects/0ca77960403e4d3889a0f5d3308ef34e` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:17.520401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca77960403e4d3889a0f5d3308ef34e)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:17.522569 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:17.577412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca77960403e4d3889a0f5d3308ef34e', 'request_id': 'req-2b467ff5-79d0-4d69-9c90-5fa42068272f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.585776 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca77960403e4d3889a0f5d3308ef34e', 'request_id': 'req-2b467ff5-79d0-4d69-9c90-5fa42068272f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.596717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca77960403e4d3889a0f5d3308ef34e', 'request_id': 'req-2b467ff5-79d0-4d69-9c90-5fa42068272f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.610078 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] The token cache is being invalidate because project 0ca77960403e4d3889a0f5d3308ef34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:35:17.610387 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.611141 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.613157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1233/2464] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:35:17 2021] DELETE /identity/v3/projects/0ca77960403e4d3889a0f5d3308ef34e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:17.617831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:17.628945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344069-d469-40fc-b20d-c6b483506aa1 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:17.686435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:17.687318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:17.687670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:17.687919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] PATH_INFO: `/v3/users/3e5d759f685b447a9a68489ace3dd8bb` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:17.689371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5d759f685b447a9a68489ace3dd8bb)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:17.691497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:17.740926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5d759f685b447a9a68489ace3dd8bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.755284 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5d759f685b447a9a68489ace3dd8bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.756260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5d759f685b447a9a68489ace3dd8bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.771617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5d759f685b447a9a68489ace3dd8bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.772351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5d759f685b447a9a68489ace3dd8bb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:17.789973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1232/2465] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:35:17 2021] DELETE /identity/v3/users/3e5d759f685b447a9a68489ace3dd8bb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:18.245115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:18.246974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:18.262829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b467ff5-79d0-4d69-9c90-5fa42068272f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:18.326957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:18.327875 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:18.328351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:18.328739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] PATH_INFO: `/v3/projects/f39c0b8713394cb0a938d61753fc2095` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:18.329970 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39c0b8713394cb0a938d61753fc2095)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:18.331977 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:18.400314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39c0b8713394cb0a938d61753fc2095', 'request_id': 'req-c20b1409-77c5-41a2-a9c4-da39ca0ec787'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.407470 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39c0b8713394cb0a938d61753fc2095', 'request_id': 'req-c20b1409-77c5-41a2-a9c4-da39ca0ec787'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.416041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39c0b8713394cb0a938d61753fc2095', 'request_id': 'req-c20b1409-77c5-41a2-a9c4-da39ca0ec787'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.429265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] The token cache is being invalidate because project f39c0b8713394cb0a938d61753fc2095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:35:18.429543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.430265 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.431864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1234/2466] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:35:18 2021] DELETE /identity/v3/projects/f39c0b8713394cb0a938d61753fc2095 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:18.437472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:18.439050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:18.452215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751ae08-faec-4204-91e6-5734cb55065b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:18.510763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:18.511819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:18.512246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:18.512576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] PATH_INFO: `/v3/users/b5dbe7ef0e054a22bc7e8836ae4ca56f` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:18.513805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5dbe7ef0e054a22bc7e8836ae4ca56f)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:18.515809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:18.564409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5dbe7ef0e054a22bc7e8836ae4ca56f'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.572290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5dbe7ef0e054a22bc7e8836ae4ca56f'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.573090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5dbe7ef0e054a22bc7e8836ae4ca56f'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.588057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5dbe7ef0e054a22bc7e8836ae4ca56f'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.589353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1d1feac1-33bc-4139-8df8-210889130a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5dbe7ef0e054a22bc7e8836ae4ca56f'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:18.609056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1233/2467] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:35:18 2021] DELETE /identity/v3/users/b5dbe7ef0e054a22bc7e8836ae4ca56f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:18.895627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:18.897333 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:18.910903 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b1409-77c5-41a2-a9c4-da39ca0ec787 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:18.971835 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:18.972900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:18.973264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:18.973636 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] PATH_INFO: `/v3/projects/18c7ef81199e4e93b9795e3066a39088` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:18.975753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c7ef81199e4e93b9795e3066a39088)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:18.978789 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.029267 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c7ef81199e4e93b9795e3066a39088', 'request_id': 'req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:19.035944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c7ef81199e4e93b9795e3066a39088', 'request_id': 'req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:19.045851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c7ef81199e4e93b9795e3066a39088', 'request_id': 'req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:19.057206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] The token cache is being invalidate because project 18c7ef81199e4e93b9795e3066a39088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:35:19.057500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:19.058252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-42ee1ebf-372b-45a1-bec5-7aa92a8c5d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:19.060783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1235/2468] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:35:18 2021] DELETE /identity/v3/projects/18c7ef81199e4e93b9795e3066a39088 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:19.066565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f83034-dce0-40d7-b9f5-8d9bf284c27f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.066856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f83034-dce0-40d7-b9f5-8d9bf284c27f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.067132 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f83034-dce0-40d7-b9f5-8d9bf284c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.087044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-98f83034-dce0-40d7-b9f5-8d9bf284c27f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:19.088337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-98f83034-dce0-40d7-b9f5-8d9bf284c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:19.153222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1234/2469] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:19.161203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58904-6ba1-4d23-b64c-663588663a03 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.161486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58904-6ba1-4d23-b64c-663588663a03 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.161760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58904-6ba1-4d23-b64c-663588663a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.182670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-dab58904-6ba1-4d23-b64c-663588663a03 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:19.184234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-dab58904-6ba1-4d23-b64c-663588663a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:19.195510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1236/2470] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:19.199967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f83034-dce0-40d7-b9f5-8d9bf284c27f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:19.209748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f83034-dce0-40d7-b9f5-8d9bf284c27f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:19.214579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:19.215290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.215603 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.215873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.216621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:35:19.216924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:19.218539 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.233271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1235/2471] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:35:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:35:19.235007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58904-6ba1-4d23-b64c-663588663a03 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:19.244406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58904-6ba1-4d23-b64c-663588663a03 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:19.249597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:19.250273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.250745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.251022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.251798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:19.253738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.283391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1237/2472] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:35:19 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:35:19.286118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:19.296396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e07800-1f35-4386-93c9-1cbeb24da87c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:19.350964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:19.351666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.351949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.352221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.352947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:19.354890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.376538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1236/2473] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:35:19 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:35:19.382132 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:19.395005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4c08-536d-4ab3-997c-9bee8a35ce9a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:19.400003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:19.400700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.400982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.401258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.401990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:19.403742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.414538 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1238/2474] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:35:19.419432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:19.429877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d0391-0383-4d33-bec6-724eb88b1df6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:19.437010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526cc76-9637-4ca6-9b5d-3076ee3d21f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:19.437690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526cc76-9637-4ca6-9b5d-3076ee3d21f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.438322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526cc76-9637-4ca6-9b5d-3076ee3d21f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.438322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526cc76-9637-4ca6-9b5d-3076ee3d21f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.439011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526cc76-9637-4ca6-9b5d-3076ee3d21f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:19.440706 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526cc76-9637-4ca6-9b5d-3076ee3d21f7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.452448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1237/2475] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:35:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:35:19.456782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:19.472611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2c138-a2da-486e-8b1f-1fa200846bba admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:19.478111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:19.479005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.479281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.479588 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] PATH_INFO: `/v3/projects/2dc92177ed0c4f6e90ebbcdb3794bf56/users/271d042b5b5e4c7d93d2d53e345862c3/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.495640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dc92177ed0c4f6e90ebbcdb3794bf56, user_id=271d042b5b5e4c7d93d2d53e345862c3, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:19.498353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.513815 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1239/2476] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:35:19 2021] PUT /identity/v3/projects/2dc92177ed0c4f6e90ebbcdb3794bf56/users/271d042b5b5e4c7d93d2d53e345862c3/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:19.524943 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c970a-27d4-48fe-867d-932a061aebec None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.525451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c970a-27d4-48fe-867d-932a061aebec None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.525791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c970a-27d4-48fe-867d-932a061aebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.554105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-461c970a-27d4-48fe-867d-932a061aebec None None] MFA Rules not processed for user `271d042b5b5e4c7d93d2d53e345862c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:19.555480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-461c970a-27d4-48fe-867d-932a061aebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:19.628785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1238/2477] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:19 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:19.639974 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:19.641962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:19.706849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84112f0a-cd38-499e-a69d-928e143a2b0e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:19.710555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:19.711242 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:19.711551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:19.711851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:19.720701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:19.722443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:19.732927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1240/2478] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:19 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:21.114760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:21.115330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:21.115330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:21.136227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] MFA Rules not processed for user `271d042b5b5e4c7d93d2d53e345862c3`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:21.137493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:21.145752 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1239/2479] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:21 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:24.733275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:24.734796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:24.802644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65203073-6012-4d5a-ae8b-fe455ee0d2ce service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:24.806549 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fa9d0-21c8-4c06-855c-d0add0351a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:24.807301 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fa9d0-21c8-4c06-855c-d0add0351a0c service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:24.807614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fa9d0-21c8-4c06-855c-d0add0351a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:24.807893 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fa9d0-21c8-4c06-855c-d0add0351a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:24.810067 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-da6fa9d0-21c8-4c06-855c-d0add0351a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:24.890345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fa9d0-21c8-4c06-855c-d0add0351a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:24.891946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fa9d0-21c8-4c06-855c-d0add0351a0c service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:24.905473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1241/2480] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:24 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:26.665901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:26.667552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:26.758629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a049bc5-2f3d-401b-9b3a-66234a35b531 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:26.766437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:26.767434 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:26.767819 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:26.768226 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:26.771190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:26.785947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:26.788371 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:26.801409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1240/2481] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:36.416851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09645979-baa7-4a7c-b8d2-4dd815cef148 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:36.417432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09645979-baa7-4a7c-b8d2-4dd815cef148 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:36.417432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09645979-baa7-4a7c-b8d2-4dd815cef148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:36.436711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-09645979-baa7-4a7c-b8d2-4dd815cef148 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:36.438123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-09645979-baa7-4a7c-b8d2-4dd815cef148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:36.500540 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1242/2482] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:35:36 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:36.514607 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:36.516374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:36.590115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3add-409e-462f-8696-4130b69d0c2f service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:36.597545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:36.598195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:36.598476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:36.598736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:36.607780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:36.609435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:36.619645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1241/2483] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:35:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:37.263715 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec88a2-00a5-4751-8df4-6164b425cb32 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:37.264001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec88a2-00a5-4751-8df4-6164b425cb32 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:37.264320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec88a2-00a5-4751-8df4-6164b425cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:37.285397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f2ec88a2-00a5-4751-8df4-6164b425cb32 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:37.286645 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f2ec88a2-00a5-4751-8df4-6164b425cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:37.294567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1243/2484] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:35:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:37.307939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:37.319435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06457e-611c-482b-8c75-6a6b2849a86e service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:37.325525 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:37.326179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:37.326474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:37.326755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:37.335098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:37.336798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:37.344640 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1242/2485] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:35:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:37.686939 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb264d-73f1-4c8f-832c-0321d418a9af None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:37.687519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb264d-73f1-4c8f-832c-0321d418a9af None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:37.687519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb264d-73f1-4c8f-832c-0321d418a9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:37.715260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-08fb264d-73f1-4c8f-832c-0321d418a9af None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:37.717008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-08fb264d-73f1-4c8f-832c-0321d418a9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:37.734462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1244/2486] 10.222.0.58 () {58 vars in 968 bytes} [Fri Aug 27 03:35:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:37.750534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:37.760036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16850a-dcd9-414b-83ba-1d00119e05af None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:37.760397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16850a-dcd9-414b-83ba-1d00119e05af None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:37.760775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16850a-dcd9-414b-83ba-1d00119e05af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:37.762221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232b052-8475-4f69-bcf6-c4bb6b54d2f2 service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:37.767731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:37.769406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:37.769720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:37.769988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:37.779482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:37.781088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:37.781522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8e16850a-dcd9-414b-83ba-1d00119e05af None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:37.782807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8e16850a-dcd9-414b-83ba-1d00119e05af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:37.790015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1243/2487] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:35:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:37.790534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1245/2488] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:35:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:35:37.812024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:37.825705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc559d80-2ef5-4886-a9b5-70a63e211f82 service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:37.832552 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa83e28-f37b-45eb-b9d4-67395403d561 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:37.833224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa83e28-f37b-45eb-b9d4-67395403d561 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:37.833547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa83e28-f37b-45eb-b9d4-67395403d561 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:37.833820 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa83e28-f37b-45eb-b9d4-67395403d561 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:37.843136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa83e28-f37b-45eb-b9d4-67395403d561 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:37.845076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa83e28-f37b-45eb-b9d4-67395403d561 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:37.856692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1244/2489] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:35:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:35:40.073321 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16850a-dcd9-414b-83ba-1d00119e05af None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:40.162205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16850a-dcd9-414b-83ba-1d00119e05af None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:40.168290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:40.169457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:40.169957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:40.170313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] PATH_INFO: `/v3/users/271d042b5b5e4c7d93d2d53e345862c3` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:40.173416 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271d042b5b5e4c7d93d2d53e345862c3)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:40.176101 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:40.240092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271d042b5b5e4c7d93d2d53e345862c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.256637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271d042b5b5e4c7d93d2d53e345862c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.264014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271d042b5b5e4c7d93d2d53e345862c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.264774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271d042b5b5e4c7d93d2d53e345862c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.274184 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271d042b5b5e4c7d93d2d53e345862c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.285113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1246/2490] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:35:40 2021] DELETE /identity/v3/users/271d042b5b5e4c7d93d2d53e345862c3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:40.289679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:40.290253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:40.290253 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:40.309312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:40.310464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:40.381174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1245/2491] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:35:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:40.394168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:40.396050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:40.480127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eabe5e-4e50-4424-8b8d-7f087a4de3d1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:40.486574 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2f7c3-6360-403e-b833-be06d6d35174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:40.487829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2f7c3-6360-403e-b833-be06d6d35174 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:40.488432 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2f7c3-6360-403e-b833-be06d6d35174 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:40.489009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2f7c3-6360-403e-b833-be06d6d35174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:40.501584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2f7c3-6360-403e-b833-be06d6d35174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:40.503921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2f7c3-6360-403e-b833-be06d6d35174 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:40.515162 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1247/2492] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:40.722170 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:40.724045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:40.741884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee7c5-35a0-4ebe-bbd4-6ca0d46fbc3b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:40.748887 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:40.750153 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:40.750498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:40.750899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] PATH_INFO: `/v3/projects/2dc92177ed0c4f6e90ebbcdb3794bf56` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:40.752773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dc92177ed0c4f6e90ebbcdb3794bf56)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:40.757374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:40.813453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'request_id': 'req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.824118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'request_id': 'req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.830804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dc92177ed0c4f6e90ebbcdb3794bf56', 'request_id': 'req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.846164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] The token cache is being invalidate because project 2dc92177ed0c4f6e90ebbcdb3794bf56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:35:40.846928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.848277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-aa3628c1-1fd9-4127-88da-bfd9f04df0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:35:40.851839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1246/2493] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:35:40 2021] DELETE /identity/v3/projects/2dc92177ed0c4f6e90ebbcdb3794bf56 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:35:52.033070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1683b-e3fc-4156-a9ef-f8906cca2c26 None None] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:52.033833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1683b-e3fc-4156-a9ef-f8906cca2c26 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:52.033833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1683b-e3fc-4156-a9ef-f8906cca2c26 None None] PATH_INFO: `/` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:52.036208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1248/2494] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:35:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:35:52.042658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926852-c69f-4983-9870-4098765e6946 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:52.043473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926852-c69f-4983-9870-4098765e6946 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:52.043473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926852-c69f-4983-9870-4098765e6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:52.063018 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-d6926852-c69f-4983-9870-4098765e6946 None None] MFA Rules not processed for user `068da11e10ca4a788bb08a42206ca42e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:52.064315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d6926852-c69f-4983-9870-4098765e6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:52.130399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1247/2495] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:35:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:52.144278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1683b-e3fc-4156-a9ef-f8906cca2c26 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:52.146188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-10f1683b-e3fc-4156-a9ef-f8906cca2c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:52.210099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1683b-e3fc-4156-a9ef-f8906cca2c26 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:52.214218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7a9d7-a448-472e-b071-dbd0d4ce2eed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b43f60d8ae5f4e8cb3ba57f76777ac84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:52.214873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a9d7-a448-472e-b071-dbd0d4ce2eed service glance] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:52.215172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a9d7-a448-472e-b071-dbd0d4ce2eed service glance] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:52.215465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7a9d7-a448-472e-b071-dbd0d4ce2eed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:52.226046 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7a9d7-a448-472e-b071-dbd0d4ce2eed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:52.227558 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7a9d7-a448-472e-b071-dbd0d4ce2eed service glance] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:52.238359 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1249/2496] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:52.315535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa2475-2b65-4467-9c4a-be72afd769dd None None] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:52.315921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa2475-2b65-4467-9c4a-be72afd769dd None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:52.316203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa2475-2b65-4467-9c4a-be72afd769dd None None] PATH_INFO: `/` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:52.318115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1248/2497] 10.222.0.58 () {54 vars in 921 bytes} [Fri Aug 27 03:35:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 03:35:52.325717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2258cf-3be4-4dc1-9858-97ffa5abbb1f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:52.326010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2258cf-3be4-4dc1-9858-97ffa5abbb1f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:52.326273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2258cf-3be4-4dc1-9858-97ffa5abbb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:52.344918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-2c2258cf-3be4-4dc1-9858-97ffa5abbb1f None None] MFA Rules not processed for user `3357ca71ec4443f8a9fba9b7ac4cfdd0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:52.346144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2c2258cf-3be4-4dc1-9858-97ffa5abbb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:52.402490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1250/2498] 10.222.0.58 () {58 vars in 1019 bytes} [Fri Aug 27 03:35:52 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:35:52.415204 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa2475-2b65-4467-9c4a-be72afd769dd None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:52.417351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-bffa2475-2b65-4467-9c4a-be72afd769dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:52.432967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa2475-2b65-4467-9c4a-be72afd769dd None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:52.437107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:52.437751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:52.438030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:52.438326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:52.446463 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:52.447981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:52.457218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1249/2499] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:35:52 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:35:54.358880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67408aa6-de83-460e-b1c6-ca617a4e2476 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:54.359616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67408aa6-de83-460e-b1c6-ca617a4e2476 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:54.359616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67408aa6-de83-460e-b1c6-ca617a4e2476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:54.383871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-67408aa6-de83-460e-b1c6-ca617a4e2476 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:35:54.385108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-67408aa6-de83-460e-b1c6-ca617a4e2476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:54.454635 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1251/2500] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:35:54 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:35:54.469135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:35:54.470964 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:35:54.548514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226d2df-061b-4b0a-9965-799b9e12af4c service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:35:54.555288 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:35:54.555994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:35:54.556267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:35:54.556536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:35:54.565561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:35:54.567260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:35:54.575291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1250/2501] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:35:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:13.572708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:13.573276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:13.573276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:13.592454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:36:13.593658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:13.603037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1252/2502] 10.222.0.58 () {58 vars in 968 bytes} [Fri Aug 27 03:36:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:36:13.618254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:13.631749 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286afd-2709-449c-8c40-8d2d1dddaf70 service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:13.641834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:13.642809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:13.643209 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:13.643600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:13.654267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:13.656205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:13.669750 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1251/2503] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:36:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:47.369839 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:47.371932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:47.386245 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a45074-c1ed-46fe-bea7-a66b99895e9c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:47.391103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:47.391832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:47.392114 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:47.392399 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:47.394547 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:47.460366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:47.462005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:47.473107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1253/2504] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:36:47 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:36:51.704232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:51.715521 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ad9c4-5091-47ba-b524-e9cf7b557147 service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:51.720983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:51.721654 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:51.721929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:51.722198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:51.723995 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:51.796403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:51.798090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:51.808843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1252/2505] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:36:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:36:52.573712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:52.583300 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98524233-d097-458c-9ea4-160a4ffa925c service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:52.587275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:52.587988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:52.588275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:52.588554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:52.590572 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:52.609306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:52.612111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:52.622750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1254/2506] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:36:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:36:56.295796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:56.302474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:56.322978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d339cc-bd49-4543-9e40-c1580e87821c service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:56.335055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:56.336178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:56.338358 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:56.338779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] PATH_INFO: `/v3/users/5c8979c080c54e9096de897a22ba40b3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:56.346216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8979c080c54e9096de897a22ba40b3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:56.349390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:56.456182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8979c080c54e9096de897a22ba40b3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:56.465006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8979c080c54e9096de897a22ba40b3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:56.466185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8979c080c54e9096de897a22ba40b3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:56.482928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8979c080c54e9096de897a22ba40b3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:56.483757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cea96ac5-997f-45e8-8ed8-8a40be5807b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8979c080c54e9096de897a22ba40b3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:56.515324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1253/2507] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:36:56 2021] DELETE /identity/v3/users/5c8979c080c54e9096de897a22ba40b3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:36:56.800370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:56.820539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab2ba4-c382-466e-a10f-31dfdd664e6c service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:56.897215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:56.898108 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:56.898838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:56.898838 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] PATH_INFO: `/v3/projects/527dc9638ff74cfda148b7cf1b61c6c8` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:56.900172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527dc9638ff74cfda148b7cf1b61c6c8)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:56.902181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:56.972491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527dc9638ff74cfda148b7cf1b61c6c8', 'request_id': 'req-3c20b247-17e3-4933-bb49-1cd2a3404843'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:56.980717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527dc9638ff74cfda148b7cf1b61c6c8', 'request_id': 'req-3c20b247-17e3-4933-bb49-1cd2a3404843'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:56.995133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527dc9638ff74cfda148b7cf1b61c6c8', 'request_id': 'req-3c20b247-17e3-4933-bb49-1cd2a3404843'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:57.012720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] The token cache is being invalidate because project 527dc9638ff74cfda148b7cf1b61c6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:36:57.013034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:57.014126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-3c20b247-17e3-4933-bb49-1cd2a3404843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:36:57.017337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1255/2508] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:36:56 2021] DELETE /identity/v3/projects/527dc9638ff74cfda148b7cf1b61c6c8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:36:57.023264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f684-bb18-4e01-a44e-ef8f437886a0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.023592 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f684-bb18-4e01-a44e-ef8f437886a0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.023950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f684-bb18-4e01-a44e-ef8f437886a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.050880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0fc2f684-bb18-4e01-a44e-ef8f437886a0 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:36:57.052629 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0fc2f684-bb18-4e01-a44e-ef8f437886a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:57.155068 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1254/2509] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:36:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:36:57.164778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b80d-5c74-446f-9252-1af0947c4725 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.165063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b80d-5c74-446f-9252-1af0947c4725 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.165340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724b80d-5c74-446f-9252-1af0947c4725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.190008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8724b80d-5c74-446f-9252-1af0947c4725 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:36:57.191491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8724b80d-5c74-446f-9252-1af0947c4725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:57.200708 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1256/2510] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:36:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:36:57.205954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f684-bb18-4e01-a44e-ef8f437886a0 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:57.221533 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f684-bb18-4e01-a44e-ef8f437886a0 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:57.228738 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:57.229809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.230618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.231151 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.232725 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:36:57.233665 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:57.237986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:57.252816 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1255/2511] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:36:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:36:57.257485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b80d-5c74-446f-9252-1af0947c4725 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:57.275227 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724b80d-5c74-446f-9252-1af0947c4725 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:57.286691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:57.287892 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.288169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.288502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.289221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:57.293334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:57.359414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1257/2512] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:36:57 2021] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:36:57.363528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:57.388672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e04cb-e389-4a1b-88c6-91b30229ab89 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:57.530576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:57.531836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.532410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.532929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.534277 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:57.536739 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:57.583036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1256/2513] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:36:57 2021] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:36:57.586982 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:57.601702 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e6b8-079f-4826-b0d4-165d591d270b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:57.617185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:57.617930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.618203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.618479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.619230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:57.621145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:57.646007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1258/2514] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:36:57.651549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:57.674070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d3544-7305-4f6d-8d87-3e81422e522f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:57.680466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee5d1e-b8f3-482f-8522-6c547199de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:57.681976 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5d1e-b8f3-482f-8522-6c547199de01 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.682716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5d1e-b8f3-482f-8522-6c547199de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.683478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee5d1e-b8f3-482f-8522-6c547199de01 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.685467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5d1e-b8f3-482f-8522-6c547199de01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:57.690931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee5d1e-b8f3-482f-8522-6c547199de01 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:57.711630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1257/2515] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:36:57.713798 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:57.733479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f44f-bf04-4de3-a7c8-771d329831e9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:57.740481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:57.742011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.742421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.742801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] PATH_INFO: `/v3/projects/819105cad688444f8135cde325914091/users/1419f882576b400dacc543b4b032354f/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.765189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=819105cad688444f8135cde325914091, user_id=1419f882576b400dacc543b4b032354f, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:57.771071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:57.790847 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1259/2516] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:36:57 2021] PUT /identity/v3/projects/819105cad688444f8135cde325914091/users/1419f882576b400dacc543b4b032354f/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:36:57.805218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:57.805892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:57.806409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:57.856833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] MFA Rules not processed for user `1419f882576b400dacc543b4b032354f`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:36:57.858320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:58.017298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1258/2517] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:36:57 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:36:58.018342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:36:58.020342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:36:58.128737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d10a9-2774-45ce-be71-2f8b915cd11c admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:36:58.137113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:36:58.138852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:36:58.139296 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:36:58.139837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:36:58.149412 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:36:58.151289 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:36:58.161427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1260/2518] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:36:58 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:37:00.965103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:00.966673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:00.994439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:01.028561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59cd13-0097-47f3-b735-e11aa420e775 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:01.037831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ca08e-0caf-4888-af7e-7e5edb3a8dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:01.038557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ca08e-0caf-4888-af7e-7e5edb3a8dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:01.038852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ca08e-0caf-4888-af7e-7e5edb3a8dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:01.039138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ca08e-0caf-4888-af7e-7e5edb3a8dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:01.043487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f93ca08e-0caf-4888-af7e-7e5edb3a8dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:01.077853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76b92-103a-4562-9b99-b5595a42d4b8 service nova] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:01.084111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:01.085181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:01.085537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:01.085894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] PATH_INFO: `/v3/users/1419f882576b400dacc543b4b032354f` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:01.087423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1419f882576b400dacc543b4b032354f)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:01.089473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:01.122353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ca08e-0caf-4888-af7e-7e5edb3a8dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:01.123883 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ca08e-0caf-4888-af7e-7e5edb3a8dc5 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:01.140337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1259/2519] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:01.154406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1419f882576b400dacc543b4b032354f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.167929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1419f882576b400dacc543b4b032354f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.175490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1419f882576b400dacc543b4b032354f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.176570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1419f882576b400dacc543b4b032354f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.194667 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1419f882576b400dacc543b4b032354f'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.201481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1261/2520] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:00 2021] DELETE /identity/v3/users/1419f882576b400dacc543b4b032354f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:01.206892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:01.207588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:01.207932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:01.228190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:01.230500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:01.303971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1260/2521] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:01.311250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:01.313112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:01.377685 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077328c-b6cd-43cd-831b-da33d683adb1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:01.382686 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61299cf-3409-4fe9-802e-8cd5510624b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:01.383376 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61299cf-3409-4fe9-802e-8cd5510624b1 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:01.383654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61299cf-3409-4fe9-802e-8cd5510624b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:01.383952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61299cf-3409-4fe9-802e-8cd5510624b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:01.396001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61299cf-3409-4fe9-802e-8cd5510624b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:01.397844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61299cf-3409-4fe9-802e-8cd5510624b1 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:01.410241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1262/2522] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:01.762063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:01.764554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:01.785540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7677ff-d9d9-4eaa-95d4-7f7f445be1f8 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:01.808373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:01.809471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:01.809822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:01.813453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] PATH_INFO: `/v3/projects/819105cad688444f8135cde325914091` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:01.814703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=819105cad688444f8135cde325914091)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:01.817351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:01.873715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819105cad688444f8135cde325914091', 'request_id': 'req-9eebd9a6-6659-4a9d-a875-2abd828960d5'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.886045 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819105cad688444f8135cde325914091', 'request_id': 'req-9eebd9a6-6659-4a9d-a875-2abd828960d5'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.900095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819105cad688444f8135cde325914091', 'request_id': 'req-9eebd9a6-6659-4a9d-a875-2abd828960d5'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.924302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] The token cache is being invalidate because project 819105cad688444f8135cde325914091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:01.924696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.928743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9eebd9a6-6659-4a9d-a875-2abd828960d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:01.931613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1261/2523] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:01 2021] DELETE /identity/v3/projects/819105cad688444f8135cde325914091 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:01.939091 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5d73a-fa53-4a04-9f73-bd69a09249f7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:01.939481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5d73a-fa53-4a04-9f73-bd69a09249f7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:01.939889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5d73a-fa53-4a04-9f73-bd69a09249f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:01.962979 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-6da5d73a-fa53-4a04-9f73-bd69a09249f7 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:01.964324 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6da5d73a-fa53-4a04-9f73-bd69a09249f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:02.027508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1263/2524] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:02.035588 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda77f-3770-4dbe-82cc-668b7fdbf7aa None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.036726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda77f-3770-4dbe-82cc-668b7fdbf7aa None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.037005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcda77f-3770-4dbe-82cc-668b7fdbf7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.060715 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cbcda77f-3770-4dbe-82cc-668b7fdbf7aa None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:02.062282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cbcda77f-3770-4dbe-82cc-668b7fdbf7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:02.070974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1262/2525] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:02.075542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5d73a-fa53-4a04-9f73-bd69a09249f7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.085349 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5d73a-fa53-4a04-9f73-bd69a09249f7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.090421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.091253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.091650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.092022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.092833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:37:02.093401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.095517 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.108371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1264/2526] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:37:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:37:02.113436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda77f-3770-4dbe-82cc-668b7fdbf7aa None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.123636 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcda77f-3770-4dbe-82cc-668b7fdbf7aa None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.129699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.130653 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.131217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.131622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.132332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.136973 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.167389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1263/2527] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:02 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:37:02.169670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.180929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673795f-4200-45aa-b922-ca0dcd584277 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.214993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.216863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:02.245471 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.246214 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.246664 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.247123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.248273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.250832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.272935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1265/2528] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:02 2021] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:02.278516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.290570 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322212c-61fe-4680-ae6e-2f0789aeac31 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.291911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66387a7c-29fc-4102-a681-b763a880d294 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.296275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.297300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.297487 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.297778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.298142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] PATH_INFO: `/v3/users/e7811e8849c74b2b9aa9182bec90fc7d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.298698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.298925 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.299202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.299405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7811e8849c74b2b9aa9182bec90fc7d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.300122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.301880 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.302220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.313096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1266/2529] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:02.317221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.328278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4ed2f-6511-4efa-8d4c-8a8b35a39510 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.334014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.334802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.335113 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.335502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.336291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.338183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.350086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1267/2530] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:02.351639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7811e8849c74b2b9aa9182bec90fc7d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.354254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.359550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7811e8849c74b2b9aa9182bec90fc7d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.360528 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7811e8849c74b2b9aa9182bec90fc7d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.364157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff2975-3830-4a3b-bf68-b819e6825d45 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.372034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7811e8849c74b2b9aa9182bec90fc7d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.372931 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-fa030021-eded-40e3-8a2f-350231124936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7811e8849c74b2b9aa9182bec90fc7d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.380377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.381618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.382104 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.382581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] PATH_INFO: `/v3/projects/8950c91f8283402f9c0098ac80e233f1/users/5fe0d5fc5af84f298cdc6e5dd7febeb3/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.385984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1264/2531] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:02 2021] DELETE /identity/v3/users/e7811e8849c74b2b9aa9182bec90fc7d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:02.401126 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8950c91f8283402f9c0098ac80e233f1, user_id=5fe0d5fc5af84f298cdc6e5dd7febeb3, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.403814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.419906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1268/2532] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:02 2021] PUT /identity/v3/projects/8950c91f8283402f9c0098ac80e233f1/users/5fe0d5fc5af84f298cdc6e5dd7febeb3/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:02.433171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.433922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.435900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.465921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] MFA Rules not processed for user `5fe0d5fc5af84f298cdc6e5dd7febeb3`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:02.467168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:02.539630 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1265/2533] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:02 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:02.551240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.553285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:02.592147 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.594134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:02.644138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032b04c-c5d9-4fb7-ba95-8c12be97b4f0 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.651465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.652326 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.652622 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.652907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.665791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.667534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.681634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1269/2534] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:02 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:37:02.697459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c27cf3-71e6-46b3-9abd-59f9df085294 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.702466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.704921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.705376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.705720 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] PATH_INFO: `/v3/projects/90c43de7a6384b82b35f14a762da5d37` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.708058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c43de7a6384b82b35f14a762da5d37)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.711452 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.807126 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c43de7a6384b82b35f14a762da5d37', 'request_id': 'req-e92a16f2-ec5f-4530-b069-a0e560535180'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.817268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c43de7a6384b82b35f14a762da5d37', 'request_id': 'req-e92a16f2-ec5f-4530-b069-a0e560535180'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.824848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c43de7a6384b82b35f14a762da5d37', 'request_id': 'req-e92a16f2-ec5f-4530-b069-a0e560535180'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.852114 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] The token cache is being invalidate because project 90c43de7a6384b82b35f14a762da5d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:02.852416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.853091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:02.857794 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1266/2535] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:02 2021] DELETE /identity/v3/projects/90c43de7a6384b82b35f14a762da5d37 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:02.859426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.878375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8d2f8-6c81-4b3e-bdf2-93289c68138d service nova] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.902815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:02.904328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:02.938079 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.938876 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.939146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.939446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] PATH_INFO: `/v3/users/0c97d67925b84f96884ea310ae5f5689` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.940750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c97d67925b84f96884ea310ae5f5689)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.942697 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.972776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a16f2-ec5f-4530-b069-a0e560535180 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:02.979262 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:02.980200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:02.980492 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:02.980767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] PATH_INFO: `/v3/users/5fe0d5fc5af84f298cdc6e5dd7febeb3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:02.981993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe0d5fc5af84f298cdc6e5dd7febeb3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:02.984261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:02.995096 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c97d67925b84f96884ea310ae5f5689'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.008040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c97d67925b84f96884ea310ae5f5689'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.016244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c97d67925b84f96884ea310ae5f5689'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.017120 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c97d67925b84f96884ea310ae5f5689'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.024843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-c227d710-09f8-4218-a368-2d4a3cd02f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c97d67925b84f96884ea310ae5f5689'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.031675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1270/2536] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:02 2021] DELETE /identity/v3/users/0c97d67925b84f96884ea310ae5f5689 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:03.040073 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe0d5fc5af84f298cdc6e5dd7febeb3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.048771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe0d5fc5af84f298cdc6e5dd7febeb3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.049742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe0d5fc5af84f298cdc6e5dd7febeb3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.069390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe0d5fc5af84f298cdc6e5dd7febeb3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.070163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe0d5fc5af84f298cdc6e5dd7febeb3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.097287 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1267/2537] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:02 2021] DELETE /identity/v3/users/5fe0d5fc5af84f298cdc6e5dd7febeb3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:03.101908 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:03.102394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:03.102672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:03.121495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:03.122990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:03.195367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1271/2538] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:03.206792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:03.208205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:03.245228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:03.246949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:03.273131 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1d589-7d1a-4975-b440-1ed281e55d29 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:03.285836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:03.286689 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:03.287002 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:03.287275 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] PATH_INFO: `/v3/projects/ac8805c0009843f799c44fc1f675cb23` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:03.290221 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8805c0009843f799c44fc1f675cb23)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:03.293878 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:03.301328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd889f1c-de21-4b15-af46-fd5921f6e0ce admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:03.305271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:03.306044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:03.306416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:03.307169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:03.321029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:03.322785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:03.333681 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1268/2539] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:03.363181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8805c0009843f799c44fc1f675cb23', 'request_id': 'req-d4ed4262-1f87-46cd-9f26-ec63709538a6'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.377193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8805c0009843f799c44fc1f675cb23', 'request_id': 'req-d4ed4262-1f87-46cd-9f26-ec63709538a6'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.387065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8805c0009843f799c44fc1f675cb23', 'request_id': 'req-d4ed4262-1f87-46cd-9f26-ec63709538a6'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.407386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] The token cache is being invalidate because project ac8805c0009843f799c44fc1f675cb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:03.407927 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.408745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-d4ed4262-1f87-46cd-9f26-ec63709538a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.415401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1272/2540] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:03 2021] DELETE /identity/v3/projects/ac8805c0009843f799c44fc1f675cb23 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:03.742686 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:03.744134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:03.764596 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fb18f-b42a-45c5-a3ad-7c4bacb8c71e service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:03.825212 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:03.826128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:03.826407 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:03.826676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] PATH_INFO: `/v3/projects/8950c91f8283402f9c0098ac80e233f1` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:03.828138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8950c91f8283402f9c0098ac80e233f1)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:03.830580 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:03.895908 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8950c91f8283402f9c0098ac80e233f1', 'request_id': 'req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.908484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8950c91f8283402f9c0098ac80e233f1', 'request_id': 'req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.917404 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8950c91f8283402f9c0098ac80e233f1', 'request_id': 'req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.938989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] The token cache is being invalidate because project 8950c91f8283402f9c0098ac80e233f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:03.940211 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.942547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-1efe8d36-c1c0-4da1-8a69-318eb6f45f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:03.944989 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1269/2541] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:03 2021] DELETE /identity/v3/projects/8950c91f8283402f9c0098ac80e233f1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:03.953024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4e5ea-1983-48aa-9e01-2a3fcbc6aa01 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:03.953666 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4e5ea-1983-48aa-9e01-2a3fcbc6aa01 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:03.954597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4e5ea-1983-48aa-9e01-2a3fcbc6aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:03.974478 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-53c4e5ea-1983-48aa-9e01-2a3fcbc6aa01 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:03.975749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-53c4e5ea-1983-48aa-9e01-2a3fcbc6aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:04.041603 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1273/2542] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:04.051756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb87a-b04f-4896-90d5-5974228f9666 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.052305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb87a-b04f-4896-90d5-5974228f9666 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.052305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb87a-b04f-4896-90d5-5974228f9666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.072970 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-e0cfb87a-b04f-4896-90d5-5974228f9666 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:04.074379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e0cfb87a-b04f-4896-90d5-5974228f9666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:04.083482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1270/2543] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:04.087755 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4e5ea-1983-48aa-9e01-2a3fcbc6aa01 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.098223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4e5ea-1983-48aa-9e01-2a3fcbc6aa01 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.103717 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.104455 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.104721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.104994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.105765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:37:04.106070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.107739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.119944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1274/2544] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:37:04.124745 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfb87a-b04f-4896-90d5-5974228f9666 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.134438 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfb87a-b04f-4896-90d5-5974228f9666 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.139705 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.140621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.140980 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.141338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.142133 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.144323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.176791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1271/2545] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:04 2021] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:04.178088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.189270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77440bbe-dab2-428f-ad74-c9e6d11100ed admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.248812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.249620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.250014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.250533 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.251007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.252994 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.278506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1275/2546] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:04 2021] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:04.279899 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.291605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30c22-5394-4110-ae68-1038a40d1c76 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.297796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.298572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.298914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.299249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.300103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.302088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.312786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1272/2547] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:04 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:04.317585 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.328260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fcf6c-365e-4289-8a56-3199e5191f4a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.333290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005678f-b7b8-4fae-959b-ba563cf390e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.334077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005678f-b7b8-4fae-959b-ba563cf390e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.334458 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005678f-b7b8-4fae-959b-ba563cf390e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.334841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005678f-b7b8-4fae-959b-ba563cf390e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.335750 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005678f-b7b8-4fae-959b-ba563cf390e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.337495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005678f-b7b8-4fae-959b-ba563cf390e9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.350148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1276/2548] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:04 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:04.354119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.364893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7915cc-1d5b-4ae1-8ff5-80ff7b651c1d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.370516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.371484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.371767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.372042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] PATH_INFO: `/v3/projects/109d1c044b134cc0b9bdab07026b95e0/users/02602f2d63c4475b8ea58c1c3769327a/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.390442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109d1c044b134cc0b9bdab07026b95e0, user_id=02602f2d63c4475b8ea58c1c3769327a, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.393993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.409611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1273/2549] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:04 2021] PUT /identity/v3/projects/109d1c044b134cc0b9bdab07026b95e0/users/02602f2d63c4475b8ea58c1c3769327a/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:04.420804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f849fd-9c66-44e8-a653-5fcd6915cd1a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.421063 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f849fd-9c66-44e8-a653-5fcd6915cd1a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.421556 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f849fd-9c66-44e8-a653-5fcd6915cd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.450202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c8f849fd-9c66-44e8-a653-5fcd6915cd1a None None] MFA Rules not processed for user `02602f2d63c4475b8ea58c1c3769327a`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:04.451492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c8f849fd-9c66-44e8-a653-5fcd6915cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:04.559150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1277/2550] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:04 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:04.560759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.684310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0798f5-e1e7-481a-af04-316a227abdb6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.690656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.691342 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.691652 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.691933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.692644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.694614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.772997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1274/2551] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:04 2021] POST /identity/v3/projects => generated 401 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:04.776552 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f849fd-9c66-44e8-a653-5fcd6915cd1a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.798627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f849fd-9c66-44e8-a653-5fcd6915cd1a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.881868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.882594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.883119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.883673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.884643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.887071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.922206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1278/2552] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:04 2021] POST /identity/v3/users => generated 307 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:04.923694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.936225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8f4e-7a11-4e24-ab1f-e84e29345205 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:04.942066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:04.942748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:04.943025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:04.943296 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:04.944063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:04.945812 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:04.959276 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1275/2553] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:04 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:04.964006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:04.988264 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bcbea-4d09-485a-8110-f0a6ac621702 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:05.010253 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:05.012420 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:05.012897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:05.013188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] PATH_INFO: `/v3/projects/af2f66aac2204228bcfd77f5fc1cc3c3/users/675abbc44c0b45af8724d9ab17f9c09e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:05.069871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2f66aac2204228bcfd77f5fc1cc3c3, user_id=675abbc44c0b45af8724d9ab17f9c09e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:05.072490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:05.098088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1279/2554] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:04 2021] PUT /identity/v3/projects/af2f66aac2204228bcfd77f5fc1cc3c3/users/675abbc44c0b45af8724d9ab17f9c09e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:05.102297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:05.118221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef37e-6afe-41ad-904b-289faf9b28ba admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:05.216921 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7e90c-0683-44d2-9b79-7acf94c203fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:05.217610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7e90c-0683-44d2-9b79-7acf94c203fa admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:05.218230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7e90c-0683-44d2-9b79-7acf94c203fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:05.218691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7e90c-0683-44d2-9b79-7acf94c203fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:05.219517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7e90c-0683-44d2-9b79-7acf94c203fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:05.221217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7e90c-0683-44d2-9b79-7acf94c203fa admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:05.236096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1276/2555] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:05 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:05.237501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:05.248213 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c128-5029-418b-acdf-5c6c423cf886 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:05.254004 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:05.255380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:05.255669 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:05.256072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] PATH_INFO: `/v3/projects/af2f66aac2204228bcfd77f5fc1cc3c3/users/675abbc44c0b45af8724d9ab17f9c09e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:05.258255 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2f66aac2204228bcfd77f5fc1cc3c3, user_id=675abbc44c0b45af8724d9ab17f9c09e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:05.260929 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:05.272453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1280/2556] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:05 2021] PUT /identity/v3/projects/af2f66aac2204228bcfd77f5fc1cc3c3/users/675abbc44c0b45af8724d9ab17f9c09e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:05.283484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f1f98-2b50-4d00-8c62-80a67d528705 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:05.283890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f1f98-2b50-4d00-8c62-80a67d528705 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:05.284219 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f1f98-2b50-4d00-8c62-80a67d528705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:05.320063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-250f1f98-2b50-4d00-8c62-80a67d528705 None None] MFA Rules not processed for user `675abbc44c0b45af8724d9ab17f9c09e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:05.322302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-250f1f98-2b50-4d00-8c62-80a67d528705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:05.421776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1277/2557] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:05 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:05.433978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:05.436238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:05.506380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f296f-776e-4287-816b-e64ba7f93010 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:05.511748 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:05.512703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:05.513138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:05.513663 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:05.537102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:05.539157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:05.555850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1281/2558] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:05 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:05.666789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f1f98-2b50-4d00-8c62-80a67d528705 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:05.688183 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f1f98-2b50-4d00-8c62-80a67d528705 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:05.693345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:05.694199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:05.694584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:05.695236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:05.767621 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:05.769237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:05.792265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1278/2559] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:05 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:37:06.295629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:06.297637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:06.379609 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35fab4-db28-406f-b870-50aa7da28814 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:06.384183 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:06.385065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:06.385345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:06.385616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] PATH_INFO: `/v3/users/75cb79bac8944976a2689f62b8d014e2` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:06.386840 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cb79bac8944976a2689f62b8d014e2)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:06.388804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:06.446763 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cb79bac8944976a2689f62b8d014e2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.459454 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cb79bac8944976a2689f62b8d014e2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.471414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cb79bac8944976a2689f62b8d014e2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.472317 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cb79bac8944976a2689f62b8d014e2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.484032 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5f306609-275c-40bd-9e32-4b70eccbff78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cb79bac8944976a2689f62b8d014e2'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.496184 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1282/2560] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:06 2021] DELETE /identity/v3/users/75cb79bac8944976a2689f62b8d014e2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:06.765091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:06.778910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce43099-6a38-4b4c-b020-e8d9e8b7ffcc service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:06.854452 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:06.855420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:06.855712 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:06.855979 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] PATH_INFO: `/v3/projects/f60ccdbc7dbb46c6abacc312e57220a1` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:06.857233 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60ccdbc7dbb46c6abacc312e57220a1)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:06.859445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:06.912584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60ccdbc7dbb46c6abacc312e57220a1', 'request_id': 'req-413eef9e-7518-4b16-ad9a-53f282ff8a70'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.919446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60ccdbc7dbb46c6abacc312e57220a1', 'request_id': 'req-413eef9e-7518-4b16-ad9a-53f282ff8a70'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.926926 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60ccdbc7dbb46c6abacc312e57220a1', 'request_id': 'req-413eef9e-7518-4b16-ad9a-53f282ff8a70'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.947642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] The token cache is being invalidate because project f60ccdbc7dbb46c6abacc312e57220a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:06.948234 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.949317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-413eef9e-7518-4b16-ad9a-53f282ff8a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:06.952254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1279/2561] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:06 2021] DELETE /identity/v3/projects/f60ccdbc7dbb46c6abacc312e57220a1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:06.961437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e63b8b-c4f3-45af-9267-01b0bc281544 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:06.961954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e63b8b-c4f3-45af-9267-01b0bc281544 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:06.962445 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e63b8b-c4f3-45af-9267-01b0bc281544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:06.990204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-74e63b8b-c4f3-45af-9267-01b0bc281544 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:06.991501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-74e63b8b-c4f3-45af-9267-01b0bc281544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:07.054732 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1283/2562] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:07.062910 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b6aa4-4137-45f7-ba12-a776c185cb12 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.063235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b6aa4-4137-45f7-ba12-a776c185cb12 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.063573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b6aa4-4137-45f7-ba12-a776c185cb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.086687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2a0b6aa4-4137-45f7-ba12-a776c185cb12 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:07.087984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2a0b6aa4-4137-45f7-ba12-a776c185cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:07.104373 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1280/2563] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:07.104781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e63b8b-c4f3-45af-9267-01b0bc281544 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:07.124926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e63b8b-c4f3-45af-9267-01b0bc281544 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:07.130083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:07.131097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.131097 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.131541 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.132373 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:37:07.132744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:07.134801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:07.151380 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1284/2564] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:37:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:37:07.153744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b6aa4-4137-45f7-ba12-a776c185cb12 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:07.166678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b6aa4-4137-45f7-ba12-a776c185cb12 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:07.174197 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:07.174930 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.175401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.176000 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.176756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:07.178790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:07.209727 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1281/2565] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:07 2021] POST /identity/v3/projects => generated 403 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:07.214016 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:07.224319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927bfc-f421-4472-b3a5-e41c7115fff4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:07.286437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:07.287342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.287650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.287907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.288595 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:07.290578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:07.317061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1285/2566] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:07 2021] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:07.321062 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:07.333088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5c7e6-d820-4da6-b5c9-1c7055a76d28 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:07.338098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:07.338763 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.339042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.339307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.340077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:07.341655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:07.360026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1282/2567] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:07.363950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:07.377986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c51f-24dd-48a8-baa6-7a447083be71 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:07.388610 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893ecb-007e-4ba2-9bfc-897020cc212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:07.389433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893ecb-007e-4ba2-9bfc-897020cc212e admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.390385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893ecb-007e-4ba2-9bfc-897020cc212e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.390966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893ecb-007e-4ba2-9bfc-897020cc212e admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.392736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893ecb-007e-4ba2-9bfc-897020cc212e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:07.400888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893ecb-007e-4ba2-9bfc-897020cc212e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:07.421474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1286/2568] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:07 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:07.426218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:07.439863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff87e7-7f77-4410-bfca-51f1873c6a82 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:07.446266 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:07.447340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.448135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.448135 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] PATH_INFO: `/v3/projects/4c115a7295c545b1b4546f1277f8101e/users/cd90c3d867a44d00ad5352d42b93a1d2/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.466834 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c115a7295c545b1b4546f1277f8101e, user_id=cd90c3d867a44d00ad5352d42b93a1d2, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:07.469872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:07.492733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1283/2569] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:07 2021] PUT /identity/v3/projects/4c115a7295c545b1b4546f1277f8101e/users/cd90c3d867a44d00ad5352d42b93a1d2/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:07.494031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2815a-c3e2-49c4-9a7b-1c5928d879f5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.494427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2815a-c3e2-49c4-9a7b-1c5928d879f5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.494723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2815a-c3e2-49c4-9a7b-1c5928d879f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.520223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ecd2815a-c3e2-49c4-9a7b-1c5928d879f5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:07.522334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ecd2815a-c3e2-49c4-9a7b-1c5928d879f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:07.595153 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1287/2570] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:07.601562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:07.603411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:07.668320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485bf79-7f36-41cc-85c2-67bbc0130228 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:07.672332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:07.672952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:07.673235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:07.673789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:07.684741 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:07.686236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:07.699634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1284/2571] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:08.361554 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf526-a384-4c7d-80c8-3d7fc2987ae7 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:08.362145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf526-a384-4c7d-80c8-3d7fc2987ae7 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:08.362145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cf526-a384-4c7d-80c8-3d7fc2987ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:08.399823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f50cf526-a384-4c7d-80c8-3d7fc2987ae7 None None] MFA Rules not processed for user `cd90c3d867a44d00ad5352d42b93a1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:08.401057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f50cf526-a384-4c7d-80c8-3d7fc2987ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:08.464957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1288/2572] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:08 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:08.469830 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:08.479915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ca6d3-755c-4c28-8ce2-a08b710f9252 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:08.486021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:08.486713 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:08.487069 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:08.487450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:08.488248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:08.490273 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:08.519476 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1285/2573] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:08 2021] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:37:08.523721 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf526-a384-4c7d-80c8-3d7fc2987ae7 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:08.535761 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cf526-a384-4c7d-80c8-3d7fc2987ae7 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:08.597611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:08.598292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:08.598650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:08.598926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:08.599711 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:08.601676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:08.624208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1289/2574] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:08 2021] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:08.628544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:08.639505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5b90b-b132-41a5-b01d-fcabac1dad04 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:08.646072 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:08.647267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:08.647678 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:08.647928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:08.648666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:08.650442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:08.666269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1286/2575] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:08.670483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:08.682232 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e44e86-4900-4dec-8dc8-5a1e51238295 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:08.689406 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:08.690806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:08.691203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:08.691328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] PATH_INFO: `/v3/projects/bb2354e6d16a40cebcdc5fd63ce58651/users/c6c0ab391a99472497d9536ba2b62c1e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:08.708280 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2354e6d16a40cebcdc5fd63ce58651, user_id=c6c0ab391a99472497d9536ba2b62c1e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:08.711297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:08.726948 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1290/2576] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:08 2021] PUT /identity/v3/projects/bb2354e6d16a40cebcdc5fd63ce58651/users/c6c0ab391a99472497d9536ba2b62c1e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:08.730945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:08.741682 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e68bc-1096-4521-b646-0086f4773011 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:08.801961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8a9c6-4ef2-45c5-8fd7-736bac7ad7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:08.802658 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a9c6-4ef2-45c5-8fd7-736bac7ad7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:08.802942 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a9c6-4ef2-45c5-8fd7-736bac7ad7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:08.803217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a9c6-4ef2-45c5-8fd7-736bac7ad7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:08.803987 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8a9c6-4ef2-45c5-8fd7-736bac7ad7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:08.805663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8a9c6-4ef2-45c5-8fd7-736bac7ad7c2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:08.815975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1287/2577] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:08 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:08.820294 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:08.831031 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4551fbe-18fb-4c62-9891-a39115c3bc0d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:08.836501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:08.836911 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:08.837136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:08.837414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] PATH_INFO: `/v3/projects/bb2354e6d16a40cebcdc5fd63ce58651/users/c6c0ab391a99472497d9536ba2b62c1e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:08.839419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2354e6d16a40cebcdc5fd63ce58651, user_id=c6c0ab391a99472497d9536ba2b62c1e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:08.842465 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:08.853518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1291/2578] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:08 2021] PUT /identity/v3/projects/bb2354e6d16a40cebcdc5fd63ce58651/users/c6c0ab391a99472497d9536ba2b62c1e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:09.495778 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddff04-5097-467e-a266-f4561fb4d6d0 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:09.496321 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddff04-5097-467e-a266-f4561fb4d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:09.496451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddff04-5097-467e-a266-f4561fb4d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:09.523736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-6fddff04-5097-467e-a266-f4561fb4d6d0 None None] MFA Rules not processed for user `c6c0ab391a99472497d9536ba2b62c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:09.524949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-6fddff04-5097-467e-a266-f4561fb4d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:09.592268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1288/2579] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:09 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:10.110822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:10.112997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:10.183936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7385de8-37ae-45de-bcad-b54ab6cacd23 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:10.189513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:10.190414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:10.190704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:10.190975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] PATH_INFO: `/v3/users/02602f2d63c4475b8ea58c1c3769327a` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:10.192295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02602f2d63c4475b8ea58c1c3769327a)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:10.194263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:10.242817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02602f2d63c4475b8ea58c1c3769327a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.256134 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02602f2d63c4475b8ea58c1c3769327a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.262922 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02602f2d63c4475b8ea58c1c3769327a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.263675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02602f2d63c4475b8ea58c1c3769327a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.273488 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02602f2d63c4475b8ea58c1c3769327a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.280904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1292/2580] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:10 2021] DELETE /identity/v3/users/02602f2d63c4475b8ea58c1c3769327a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:10.286450 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:10.287004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:10.287648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:10.310833 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:10.312731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:10.390735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1289/2581] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:10.400894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:10.402393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:10.462771 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46cc1-4346-45b5-ad37-9bc9cdf9d306 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:10.466863 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:10.467578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:10.467978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:10.468240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:10.477802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:10.479250 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:10.489678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1293/2582] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:10.694416 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:10.696527 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:10.709983 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151096-a58d-4f7e-95a7-e26c3bf03100 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:10.714494 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:10.715391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:10.715840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:10.716117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] PATH_INFO: `/v3/users/cd90c3d867a44d00ad5352d42b93a1d2` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:10.717337 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd90c3d867a44d00ad5352d42b93a1d2)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:10.719548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:10.767944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd90c3d867a44d00ad5352d42b93a1d2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.775545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd90c3d867a44d00ad5352d42b93a1d2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.776369 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd90c3d867a44d00ad5352d42b93a1d2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.789939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd90c3d867a44d00ad5352d42b93a1d2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.790896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd90c3d867a44d00ad5352d42b93a1d2'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.792553 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:10.794068 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:10.809102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17ea12-166e-41f5-a438-3c303c2de514 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:10.813099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1290/2583] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:10 2021] DELETE /identity/v3/users/cd90c3d867a44d00ad5352d42b93a1d2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:10.870728 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:10.871634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:10.871926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:10.872984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] PATH_INFO: `/v3/projects/109d1c044b134cc0b9bdab07026b95e0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:10.874350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=109d1c044b134cc0b9bdab07026b95e0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:10.876647 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:10.927661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109d1c044b134cc0b9bdab07026b95e0', 'request_id': 'req-7152b434-3528-49cb-987a-13a5396cd129'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.933794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109d1c044b134cc0b9bdab07026b95e0', 'request_id': 'req-7152b434-3528-49cb-987a-13a5396cd129'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.941493 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109d1c044b134cc0b9bdab07026b95e0', 'request_id': 'req-7152b434-3528-49cb-987a-13a5396cd129'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.951867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] The token cache is being invalidate because project 109d1c044b134cc0b9bdab07026b95e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:10.952220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.953481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:10.955101 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1294/2584] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:10 2021] DELETE /identity/v3/projects/109d1c044b134cc0b9bdab07026b95e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:10.959331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:10.960784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:10.975863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b3df0-11c9-4fa8-8b42-6d90a448968d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:10.989813 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:10.991233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:11.036406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:11.038049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.038598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.039021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] PATH_INFO: `/v3/users/675abbc44c0b45af8724d9ab17f9c09e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.040464 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675abbc44c0b45af8724d9ab17f9c09e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:11.042409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:11.067744 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b434-3528-49cb-987a-13a5396cd129 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:11.073633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:11.074658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.074954 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.075233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] PATH_INFO: `/v3/projects/4c115a7295c545b1b4546f1277f8101e` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.076448 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c115a7295c545b1b4546f1277f8101e)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:11.078801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:11.097372 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675abbc44c0b45af8724d9ab17f9c09e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.107874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675abbc44c0b45af8724d9ab17f9c09e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.108758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675abbc44c0b45af8724d9ab17f9c09e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.121996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675abbc44c0b45af8724d9ab17f9c09e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.122813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675abbc44c0b45af8724d9ab17f9c09e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.133481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c115a7295c545b1b4546f1277f8101e', 'request_id': 'req-071595c6-2cfe-4010-8d3d-48cf073f18c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.138604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1291/2585] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:10 2021] DELETE /identity/v3/users/675abbc44c0b45af8724d9ab17f9c09e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:11.140642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c115a7295c545b1b4546f1277f8101e', 'request_id': 'req-071595c6-2cfe-4010-8d3d-48cf073f18c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.148873 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c115a7295c545b1b4546f1277f8101e', 'request_id': 'req-071595c6-2cfe-4010-8d3d-48cf073f18c3'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.160714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] The token cache is being invalidate because project 4c115a7295c545b1b4546f1277f8101e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:11.161040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.161661 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.163477 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1295/2586] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:10 2021] DELETE /identity/v3/projects/4c115a7295c545b1b4546f1277f8101e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:11.167691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:11.169199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:11.232804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379eb66-7a6e-40b5-a047-681d14bb51c2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:11.238029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:11.238940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.239216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.239530 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] PATH_INFO: `/v3/users/c6c0ab391a99472497d9536ba2b62c1e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.240747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c0ab391a99472497d9536ba2b62c1e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:11.242896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:11.292685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c0ab391a99472497d9536ba2b62c1e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.299780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c0ab391a99472497d9536ba2b62c1e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.300922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c0ab391a99472497d9536ba2b62c1e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.313036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c0ab391a99472497d9536ba2b62c1e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.313815 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8da9e581-e9d9-4e7b-a7f8-e0c9afe2fb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c0ab391a99472497d9536ba2b62c1e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.329210 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1292/2587] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:11 2021] DELETE /identity/v3/users/c6c0ab391a99472497d9536ba2b62c1e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:11.521305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:11.523115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:11.596401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071595c6-2cfe-4010-8d3d-48cf073f18c3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:11.663198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:11.664218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.664513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.664788 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] PATH_INFO: `/v3/projects/bb2354e6d16a40cebcdc5fd63ce58651` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.666532 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2354e6d16a40cebcdc5fd63ce58651)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:11.668912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:11.721631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2354e6d16a40cebcdc5fd63ce58651', 'request_id': 'req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.727806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2354e6d16a40cebcdc5fd63ce58651', 'request_id': 'req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.735890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2354e6d16a40cebcdc5fd63ce58651', 'request_id': 'req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.746476 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] The token cache is being invalidate because project bb2354e6d16a40cebcdc5fd63ce58651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:11.746779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.747779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-ec7aa84a-0d6f-47d6-866f-980a9bd3469d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:11.749679 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1296/2588] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:11 2021] DELETE /identity/v3/projects/bb2354e6d16a40cebcdc5fd63ce58651 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:11.756338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903743-5bfe-4704-a011-8761140ca46d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.757235 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903743-5bfe-4704-a011-8761140ca46d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.757516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903743-5bfe-4704-a011-8761140ca46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.777063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-cb903743-5bfe-4704-a011-8761140ca46d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:11.778317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cb903743-5bfe-4704-a011-8761140ca46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:11.845710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1293/2589] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:11.854053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980d76-54d7-4519-a1dd-dde30e4a4e3c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.854356 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980d76-54d7-4519-a1dd-dde30e4a4e3c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.854625 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980d76-54d7-4519-a1dd-dde30e4a4e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.876860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-4c980d76-54d7-4519-a1dd-dde30e4a4e3c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:11.878187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-4c980d76-54d7-4519-a1dd-dde30e4a4e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:11.890900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1297/2590] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:11.895037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb903743-5bfe-4704-a011-8761140ca46d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:11.911139 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb903743-5bfe-4704-a011-8761140ca46d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:11.916789 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:11.917341 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.917806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.918090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.918825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:37:11.919306 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:11.921922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:11.935669 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1294/2591] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:37:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:37:11.940409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c980d76-54d7-4519-a1dd-dde30e4a4e3c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:11.957201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:11.959144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:11.962773 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c980d76-54d7-4519-a1dd-dde30e4a4e3c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:11.973714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fcfc9-6c55-4e4b-b6a0-0d15b23d9bf9 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:11.983192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:11.984240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.984607 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.984934 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.985120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:11.985739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:11.986113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:11.986281 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:11.986555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] PATH_INFO: `/v3/projects/af2f66aac2204228bcfd77f5fc1cc3c3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:11.987692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:11.989191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2f66aac2204228bcfd77f5fc1cc3c3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:11.990986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.018224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1298/2592] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:11 2021] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:12.022452 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.052977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2f66aac2204228bcfd77f5fc1cc3c3', 'request_id': 'req-0da851ea-c92b-465d-907d-5267aaf5cfed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:12.061356 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2f66aac2204228bcfd77f5fc1cc3c3', 'request_id': 'req-0da851ea-c92b-465d-907d-5267aaf5cfed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:12.070092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2f66aac2204228bcfd77f5fc1cc3c3', 'request_id': 'req-0da851ea-c92b-465d-907d-5267aaf5cfed'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:12.087810 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] The token cache is being invalidate because project af2f66aac2204228bcfd77f5fc1cc3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:12.088101 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:12.088785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-0da851ea-c92b-465d-907d-5267aaf5cfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:12.090497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1295/2593] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:11 2021] DELETE /identity/v3/projects/af2f66aac2204228bcfd77f5fc1cc3c3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:12.096894 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfbff-4777-4f14-90b4-070814b27a9e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.097097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfbff-4777-4f14-90b4-070814b27a9e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.097366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfbff-4777-4f14-90b4-070814b27a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.098426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc279dae-6aa9-49ff-ab0b-b45ad7bd8310 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.116052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-617cfbff-4777-4f14-90b4-070814b27a9e None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:12.117292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-617cfbff-4777-4f14-90b4-070814b27a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:12.163170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.164604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.165103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.165704 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.166408 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.168544 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.180914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1296/2594] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:12.190797 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83f6a3-56be-44d4-b300-e8bb29ac9a01 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.191238 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83f6a3-56be-44d4-b300-e8bb29ac9a01 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.191572 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83f6a3-56be-44d4-b300-e8bb29ac9a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.200421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1299/2595] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:12.201479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.203760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:12.210674 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-be83f6a3-56be-44d4-b300-e8bb29ac9a01 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:12.211955 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-be83f6a3-56be-44d4-b300-e8bb29ac9a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:12.215462 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd99c83-692f-4800-9356-5a509cd07bd6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.223779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.224157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1297/2596] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:12.226882 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.227180 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.227490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.228247 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.228988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83f6a3-56be-44d4-b300-e8bb29ac9a01 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.229921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.239023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83f6a3-56be-44d4-b300-e8bb29ac9a01 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.241279 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1300/2597] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:12.243865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.244550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.244823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.245116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.245224 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.245882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:37:12.246206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.247988 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.254987 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b572e8-ba21-499a-9a35-fd3fcf82ddbc admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.260036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.260691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.260975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.264382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1298/2598] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:37:12.264491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.264491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.264491 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.265425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.279613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1301/2599] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:37:12.279875 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48a8c-9bc6-4a19-a5e8-609f5dd07009 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.280958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.285549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.286242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.286531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.286806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.287555 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.289493 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.292618 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d51f92-c341-4a45-a9b7-323b94d17034 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.299334 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57836e51-5551-45ce-aa5f-3e0a6345a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.301443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57836e51-5551-45ce-aa5f-3e0a6345a45f admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.301997 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57836e51-5551-45ce-aa5f-3e0a6345a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.302555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57836e51-5551-45ce-aa5f-3e0a6345a45f admin admin] PATH_INFO: `/v3/projects/a94876f5cf5b467a8c7c669d55b6f701/users/3d31fc54b3ee41be9f6e01b7f278b5a3/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.321662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57836e51-5551-45ce-aa5f-3e0a6345a45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94876f5cf5b467a8c7c669d55b6f701, user_id=3d31fc54b3ee41be9f6e01b7f278b5a3, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.323025 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1299/2600] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:12.327237 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.328005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57836e51-5551-45ce-aa5f-3e0a6345a45f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.344269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1302/2601] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:12 2021] PUT /identity/v3/projects/a94876f5cf5b467a8c7c669d55b6f701/users/3d31fc54b3ee41be9f6e01b7f278b5a3/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:12.357155 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be982b-0bef-424d-b703-5f0325cd7922 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.357361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be982b-0bef-424d-b703-5f0325cd7922 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.357639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be982b-0bef-424d-b703-5f0325cd7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.391237 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-41be982b-0bef-424d-b703-5f0325cd7922 None None] MFA Rules not processed for user `3d31fc54b3ee41be9f6e01b7f278b5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:12.392539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-41be982b-0bef-424d-b703-5f0325cd7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:12.397134 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996898b-6a24-41e0-b60e-ad8f62b7134e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.458508 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.459660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.459960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.460485 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.461182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.463334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.481318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1303/2602] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:12.491771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1300/2603] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:12.491984 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be982b-0bef-424d-b703-5f0325cd7922 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.493094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.502133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be982b-0bef-424d-b703-5f0325cd7922 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.504229 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c815c7a-30ea-4a3d-8607-6f0aaa0ac90b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.507849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.508800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.509088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.509413 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.510138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.510268 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.510940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.511218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.511521 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.512246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.512353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.513895 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.524666 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1301/2604] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:12.528524 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.538958 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d19984-e9ce-48e6-93c0-aa2dd227666d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.544541 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.545218 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.545496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.545762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.546594 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.547800 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1304/2605] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:12.552054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.552637 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.563454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1302/2606] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:12.567426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.578178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43387cd1-2842-4446-92f7-9f636c2bc3c3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.618790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac59a2-3daa-42e3-8f05-a9e8cab15388 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.624599 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.625330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.625851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.626345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.627694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.630127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.635865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a443869-d7f4-4383-a780-83567a31a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.636761 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a443869-d7f4-4383-a780-83567a31a84c admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.637038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a443869-d7f4-4383-a780-83567a31a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.637311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a443869-d7f4-4383-a780-83567a31a84c admin admin] PATH_INFO: `/v3/projects/f211de002b5040e896318d98044689e4/users/22f437fb6eb94fc28ac0c673de5bf440/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.652621 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1305/2607] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:37:12.654792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a443869-d7f4-4383-a780-83567a31a84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f211de002b5040e896318d98044689e4, user_id=22f437fb6eb94fc28ac0c673de5bf440, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.656734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.657800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a443869-d7f4-4383-a780-83567a31a84c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.667191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99abf5e-3cfb-4c0d-b0ff-480e24c775ee admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.673002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1303/2608] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:12 2021] PUT /identity/v3/projects/f211de002b5040e896318d98044689e4/users/22f437fb6eb94fc28ac0c673de5bf440/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:12.683710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.684000 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.684282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.713285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] MFA Rules not processed for user `22f437fb6eb94fc28ac0c673de5bf440`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:12.714529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:12.725230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.725928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.726204 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.726439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.727218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.728862 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.738988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1306/2609] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:37:12.743386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.753473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9050603-9c83-4d79-91d6-b43367bb2688 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.758295 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.759244 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.759674 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.760107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] PATH_INFO: `/v3/projects/019148093a3c49689834432dcd4c0b9e/users/382636bf04c34da78dc5739d61b5c3ce/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.774891 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019148093a3c49689834432dcd4c0b9e, user_id=382636bf04c34da78dc5739d61b5c3ce, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.777564 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.782163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1304/2610] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:12.793394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1307/2611] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:12 2021] PUT /identity/v3/projects/019148093a3c49689834432dcd4c0b9e/users/382636bf04c34da78dc5739d61b5c3ce/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:12.793598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.795012 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:12.797435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.853418 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1523345-22ee-4aa3-8052-9f2628b18139 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.860616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a4c7-b056-434d-ac71-55448dbbde14 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.866188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.866907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.867187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.867492 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.868230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.869898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.880353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1308/2612] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:12.884577 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:12.894859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbca0c-e227-4cca-829d-28fe92022c3a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:12.899662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5c9b8-36ff-4536-8735-fd56a38e462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.900551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c9b8-36ff-4536-8735-fd56a38e462f admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.900831 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c9b8-36ff-4536-8735-fd56a38e462f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.901105 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5c9b8-36ff-4536-8735-fd56a38e462f admin admin] PATH_INFO: `/v3/projects/019148093a3c49689834432dcd4c0b9e/users/382636bf04c34da78dc5739d61b5c3ce/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.903152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5c9b8-36ff-4536-8735-fd56a38e462f admin admin] RBAC: Authorizing `identity:create_grant(project_id=019148093a3c49689834432dcd4c0b9e, user_id=382636bf04c34da78dc5739d61b5c3ce, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.905255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:12.906075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.906223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5c9b8-36ff-4536-8735-fd56a38e462f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.906323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.906608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.917778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1309/2613] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:12 2021] PUT /identity/v3/projects/019148093a3c49689834432dcd4c0b9e/users/382636bf04c34da78dc5739d61b5c3ce/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:12.928999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be295d-f242-48d6-a409-53b62594ef5d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:12.929424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be295d-f242-48d6-a409-53b62594ef5d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:12.929705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be295d-f242-48d6-a409-53b62594ef5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:12.962426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-e0be295d-f242-48d6-a409-53b62594ef5d None None] MFA Rules not processed for user `382636bf04c34da78dc5739d61b5c3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:12.963786 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e0be295d-f242-48d6-a409-53b62594ef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:12.965663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:12.967297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:12.978431 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1305/2614] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:12 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:37:12.999697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:13.012985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e4364-b410-44f2-bad6-d21416dc754d service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:13.054218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1310/2615] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:12 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:13.058900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.058900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.058900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.076346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:13.077362 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.077732 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.077871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:13.078131 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] PATH_INFO: `/v3/users/22f437fb6eb94fc28ac0c673de5bf440` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.079146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.079301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f437fb6eb94fc28ac0c673de5bf440)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:13.081459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:13.128180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f437fb6eb94fc28ac0c673de5bf440'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.134645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f437fb6eb94fc28ac0c673de5bf440'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.135330 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f437fb6eb94fc28ac0c673de5bf440'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.135500 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1311/2616] 10.222.0.58 () {58 vars in 968 bytes} [Fri Aug 27 03:37:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:13.136338 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:13.137747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.147776 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f437fb6eb94fc28ac0c673de5bf440'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.148504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f437fb6eb94fc28ac0c673de5bf440'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.164007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1306/2617] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:12 2021] DELETE /identity/v3/users/22f437fb6eb94fc28ac0c673de5bf440 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:13.164993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:13.166432 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.202803 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95edd1-57db-4565-ae50-1067e7454240 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:13.233095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94519-dda0-42de-a452-0b5d22ce4649 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:13.238178 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8293719-1017-470c-ad42-c5121f2d1efa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:13.238823 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293719-1017-470c-ad42-c5121f2d1efa service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.239099 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293719-1017-470c-ad42-c5121f2d1efa service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.239392 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293719-1017-470c-ad42-c5121f2d1efa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.241222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d8293719-1017-470c-ad42-c5121f2d1efa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.250071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:13.250753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.251051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.251304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.253161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.297938 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8293719-1017-470c-ad42-c5121f2d1efa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:13.299635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8293719-1017-470c-ad42-c5121f2d1efa service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:13.308295 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1307/2618] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:37:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:13.309690 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.310091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.310553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.318402 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:13.319973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:13.327791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:13.329166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.330834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1312/2619] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:13 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:13.395559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1308/2620] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:13.406871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:13.408543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.477988 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb437-d380-4a6c-ba55-6b5ade3d808a service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:13.483479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f81266-8b72-4ecf-b189-676f6399d078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:13.484737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81266-8b72-4ecf-b189-676f6399d078 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.485219 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81266-8b72-4ecf-b189-676f6399d078 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.485699 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f81266-8b72-4ecf-b189-676f6399d078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.498036 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f81266-8b72-4ecf-b189-676f6399d078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:13.499793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f81266-8b72-4ecf-b189-676f6399d078 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:13.512436 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1313/2621] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:37:13.639145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:13.641036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.653774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63980db3-ac2c-4f8b-88d3-335fc8251840 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:13.659821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:13.661217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.661217 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.661514 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] PATH_INFO: `/v3/users/3d31fc54b3ee41be9f6e01b7f278b5a3` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.662800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d31fc54b3ee41be9f6e01b7f278b5a3)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:13.665163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:13.732145 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d31fc54b3ee41be9f6e01b7f278b5a3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.740201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d31fc54b3ee41be9f6e01b7f278b5a3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.740945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d31fc54b3ee41be9f6e01b7f278b5a3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.754015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d31fc54b3ee41be9f6e01b7f278b5a3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.754731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d31fc54b3ee41be9f6e01b7f278b5a3'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.778016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1309/2622] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:13 2021] DELETE /identity/v3/users/3d31fc54b3ee41be9f6e01b7f278b5a3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:13.780762 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.781119 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.781409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.799107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:13.800845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.836796 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:13.838433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.877545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1314/2623] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:13.887560 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:13.889258 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:13.927425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946f412-475c-4f09-8fb0-d1e2b42a1cc8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:13.932490 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842956f4-4740-484f-b282-526165911734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:13.933399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842956f4-4740-484f-b282-526165911734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.933844 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842956f4-4740-484f-b282-526165911734 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.934125 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842956f4-4740-484f-b282-526165911734 admin admin] PATH_INFO: `/v3/projects/f211de002b5040e896318d98044689e4` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.935360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842956f4-4740-484f-b282-526165911734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f211de002b5040e896318d98044689e4)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:13.937563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842956f4-4740-484f-b282-526165911734 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:13.959973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b6a94-8711-4fe0-be95-0908862b017a None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:13.964570 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2f04d-5397-4a1e-8843-44e238bd70cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:13.965319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f04d-5397-4a1e-8843-44e238bd70cc service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:13.966040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f04d-5397-4a1e-8843-44e238bd70cc service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:13.966398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2f04d-5397-4a1e-8843-44e238bd70cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:13.977626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2f04d-5397-4a1e-8843-44e238bd70cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:13.979234 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2f04d-5397-4a1e-8843-44e238bd70cc service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:13.988504 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-842956f4-4740-484f-b282-526165911734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f211de002b5040e896318d98044689e4', 'request_id': 'req-842956f4-4740-484f-b282-526165911734'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:13.989915 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1315/2624] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:37:13.997242 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-842956f4-4740-484f-b282-526165911734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f211de002b5040e896318d98044689e4', 'request_id': 'req-842956f4-4740-484f-b282-526165911734'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.004304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-842956f4-4740-484f-b282-526165911734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f211de002b5040e896318d98044689e4', 'request_id': 'req-842956f4-4740-484f-b282-526165911734'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.018641 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-842956f4-4740-484f-b282-526165911734 admin admin] The token cache is being invalidate because project f211de002b5040e896318d98044689e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:14.018962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-842956f4-4740-484f-b282-526165911734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.019948 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-842956f4-4740-484f-b282-526165911734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.021604 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1310/2625] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:13 2021] DELETE /identity/v3/projects/f211de002b5040e896318d98044689e4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:14.028297 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3bad-1ab0-4f2b-ab2e-8b99b1e20386 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.028756 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3bad-1ab0-4f2b-ab2e-8b99b1e20386 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.029139 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e3bad-1ab0-4f2b-ab2e-8b99b1e20386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.052017 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-ed0e3bad-1ab0-4f2b-ab2e-8b99b1e20386 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:14.053480 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-ed0e3bad-1ab0-4f2b-ab2e-8b99b1e20386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:14.125785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1316/2626] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:14.133657 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ff4f4-b924-41aa-89ab-2ad479b9df8d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.134010 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ff4f4-b924-41aa-89ab-2ad479b9df8d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.134231 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ff4f4-b924-41aa-89ab-2ad479b9df8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.180811 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-207ff4f4-b924-41aa-89ab-2ad479b9df8d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:14.183448 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-207ff4f4-b924-41aa-89ab-2ad479b9df8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:14.195402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1311/2627] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:14.197066 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e3bad-1ab0-4f2b-ab2e-8b99b1e20386 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.207336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e3bad-1ab0-4f2b-ab2e-8b99b1e20386 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.212185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.212942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.213414 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.213855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.214676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:37:14.215062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.216780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.230485 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1317/2628] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:37:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:37:14.235037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ff4f4-b924-41aa-89ab-2ad479b9df8d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.244397 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ff4f4-b924-41aa-89ab-2ad479b9df8d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.249440 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.250107 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.250386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.250659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.251409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.253345 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.280322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1312/2629] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:14 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:14.285395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.298087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d1fd6-6a95-413c-a940-b558255305ba admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.308488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.310606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:14.380345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.381396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.381580 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.381973 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.382772 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.384996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.392791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78bd68-5d32-451f-bcad-f3d78e3500b5 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.397455 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.398587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.399648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.399648 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] PATH_INFO: `/v3/projects/a94876f5cf5b467a8c7c669d55b6f701` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.400851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94876f5cf5b467a8c7c669d55b6f701)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.403168 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.411714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1318/2630] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:14 2021] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:14.415914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.427235 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e1a08-1995-4a8b-addd-cce7c347994b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.436316 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.437305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.437660 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.438006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.438856 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.440620 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.452392 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1319/2631] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:37:14.456389 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.462286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94876f5cf5b467a8c7c669d55b6f701', 'request_id': 'req-a48a855d-409a-41e3-83f4-23006a8470a6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.466884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865783b-b037-4348-9c71-4147b7b9c68a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.469007 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94876f5cf5b467a8c7c669d55b6f701', 'request_id': 'req-a48a855d-409a-41e3-83f4-23006a8470a6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.475453 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94876f5cf5b467a8c7c669d55b6f701', 'request_id': 'req-a48a855d-409a-41e3-83f4-23006a8470a6'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.491839 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] The token cache is being invalidate because project a94876f5cf5b467a8c7c669d55b6f701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:14.492129 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.493200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.498310 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1313/2632] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:14 2021] DELETE /identity/v3/projects/a94876f5cf5b467a8c7c669d55b6f701 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:14.500144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.502622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:14.525849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.526841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.527293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.527810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.528703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.530496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.541738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1320/2633] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:14 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:37:14.545754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.547896 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:14.561259 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce837b-ace3-49c0-a8e6-2b5fac8a28ce admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.568812 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b92469-279d-441a-b3fc-d8a2bb9e1b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.569052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a855d-409a-41e3-83f4-23006a8470a6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.569844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92469-279d-441a-b3fc-d8a2bb9e1b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.570121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92469-279d-441a-b3fc-d8a2bb9e1b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.570397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b92469-279d-441a-b3fc-d8a2bb9e1b89 admin admin] PATH_INFO: `/v3/projects/87c503a5f4c94ed5a5d883191cf39692/users/aadbda5d4102494897e11f6818d4ca4a/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.574191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.575105 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.575406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.575685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] PATH_INFO: `/v3/users/382636bf04c34da78dc5739d61b5c3ce` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.576945 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=382636bf04c34da78dc5739d61b5c3ce)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.578960 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.587513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92469-279d-441a-b3fc-d8a2bb9e1b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c503a5f4c94ed5a5d883191cf39692, user_id=aadbda5d4102494897e11f6818d4ca4a, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.590531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b92469-279d-441a-b3fc-d8a2bb9e1b89 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.604703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1321/2634] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:14 2021] PUT /identity/v3/projects/87c503a5f4c94ed5a5d883191cf39692/users/aadbda5d4102494897e11f6818d4ca4a/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:14.610391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.610683 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.610961 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.628802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:14.630195 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:14.631571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382636bf04c34da78dc5739d61b5c3ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.638635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382636bf04c34da78dc5739d61b5c3ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.639312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382636bf04c34da78dc5739d61b5c3ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.655585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382636bf04c34da78dc5739d61b5c3ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.657137 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382636bf04c34da78dc5739d61b5c3ce'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:14.671095 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1314/2635] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:14 2021] DELETE /identity/v3/users/382636bf04c34da78dc5739d61b5c3ce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:14.697706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1322/2636] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:37:14.712918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:14.716736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:14.796426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82d7b8-558e-4d20-8ecb-4786648dd8e5 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:14.804177 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31efb58-adb3-4c98-bda5-aafb72976265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:14.805467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31efb58-adb3-4c98-bda5-aafb72976265 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:14.805917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31efb58-adb3-4c98-bda5-aafb72976265 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:14.806351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31efb58-adb3-4c98-bda5-aafb72976265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:14.896249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31efb58-adb3-4c98-bda5-aafb72976265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:14.897632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31efb58-adb3-4c98-bda5-aafb72976265 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:14.916419 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1315/2637] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:15.103900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:15.105411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:15.123116 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0f07-6808-4135-9384-a28bad35b1fc None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:15.129568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:15.137269 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.137707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.137992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] PATH_INFO: `/v3/projects/019148093a3c49689834432dcd4c0b9e` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.139391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] RBAC: Authorizing `identity:delete_project(project_id=019148093a3c49689834432dcd4c0b9e)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:15.141600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:15.200944 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019148093a3c49689834432dcd4c0b9e', 'request_id': 'req-132ce3e2-e8f0-47fe-992e-79532486725a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:15.207681 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019148093a3c49689834432dcd4c0b9e', 'request_id': 'req-132ce3e2-e8f0-47fe-992e-79532486725a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:15.217475 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019148093a3c49689834432dcd4c0b9e', 'request_id': 'req-132ce3e2-e8f0-47fe-992e-79532486725a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:15.230849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] The token cache is being invalidate because project 019148093a3c49689834432dcd4c0b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:15.231142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:15.231852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-132ce3e2-e8f0-47fe-992e-79532486725a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:15.233980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1323/2638] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:15 2021] DELETE /identity/v3/projects/019148093a3c49689834432dcd4c0b9e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:15.240182 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902324e-eb73-4275-a28b-083c0fcf3842 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.240540 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902324e-eb73-4275-a28b-083c0fcf3842 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.240882 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902324e-eb73-4275-a28b-083c0fcf3842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.264495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-c902324e-eb73-4275-a28b-083c0fcf3842 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:15.266340 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c902324e-eb73-4275-a28b-083c0fcf3842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:15.328831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1316/2639] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:15.337510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd72b-96b5-445a-a5c4-609f0f383ee6 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.337822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd72b-96b5-445a-a5c4-609f0f383ee6 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.338102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd72b-96b5-445a-a5c4-609f0f383ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.360466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-9fafd72b-96b5-445a-a5c4-609f0f383ee6 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:15.364367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-9fafd72b-96b5-445a-a5c4-609f0f383ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:15.380868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1324/2640] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:15.385862 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902324e-eb73-4275-a28b-083c0fcf3842 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:15.399041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902324e-eb73-4275-a28b-083c0fcf3842 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:15.404451 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:15.405259 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.405548 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.405809 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.406590 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:37:15.407032 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:15.408765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:15.426206 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1317/2641] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:37:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:37:15.428098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd72b-96b5-445a-a5c4-609f0f383ee6 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:15.438342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd72b-96b5-445a-a5c4-609f0f383ee6 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:15.443964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:15.444734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.445085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.445427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.446200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:15.448222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:15.482007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1325/2642] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:15 2021] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:15.484311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:15.496066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2683-4451-489d-82f2-31f03acfa196 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:15.558195 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:15.559075 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.559500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.559905 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.560717 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:15.563171 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:15.589366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1318/2643] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:15 2021] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:15.590898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:15.603282 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030919-2336-4ad2-bf53-58c7fe7ce7d7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:15.608950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:15.609753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.610057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.610850 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.611053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:15.612739 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:15.629867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1326/2644] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:15 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:15.632116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:15.656516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784860bf-2496-4dda-a99e-5ec4d38b9ceb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:15.667998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951543e6-33dc-41fb-bb31-01cb4ee3138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:15.669498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951543e6-33dc-41fb-bb31-01cb4ee3138a admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.669807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951543e6-33dc-41fb-bb31-01cb4ee3138a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.670106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951543e6-33dc-41fb-bb31-01cb4ee3138a admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.672871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951543e6-33dc-41fb-bb31-01cb4ee3138a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:15.675993 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951543e6-33dc-41fb-bb31-01cb4ee3138a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:15.691934 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1319/2645] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:15 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:15.696579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:15.709433 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f32a34-90a3-4f1f-b5a0-322bb49b9e92 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:15.714210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:15.715202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.715522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.715792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] PATH_INFO: `/v3/projects/433c3bae81f74614ad0c1296860046a9/users/18df39c351c044dcb0716a8595da83fb/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.735642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433c3bae81f74614ad0c1296860046a9, user_id=18df39c351c044dcb0716a8595da83fb, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:15.739643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:15.762310 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1327/2646] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:15 2021] PUT /identity/v3/projects/433c3bae81f74614ad0c1296860046a9/users/18df39c351c044dcb0716a8595da83fb/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:37:15.774422 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c089af-55d2-43a4-a0dd-384cd0a1ed21 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:15.774714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c089af-55d2-43a4-a0dd-384cd0a1ed21 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:15.775015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c089af-55d2-43a4-a0dd-384cd0a1ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:15.814929 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-b7c089af-55d2-43a4-a0dd-384cd0a1ed21 None None] MFA Rules not processed for user `18df39c351c044dcb0716a8595da83fb`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:15.817169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b7c089af-55d2-43a4-a0dd-384cd0a1ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:15.910744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1320/2647] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:15 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:15.915074 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.020166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4665ec4-658e-4a23-a8f5-7c12e3604ed1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.026404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.027178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.027951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.027951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.028531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.030640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.060022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.060022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.060391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.068651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1328/2648] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:37:15 2021] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:16.069879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.090963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] MFA Rules not processed for user `aadbda5d4102494897e11f6818d4ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:16.092509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:16.163832 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931ddf5-833e-4571-b40a-809a6f0b477a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.170768 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.171906 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.172385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.172855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.173782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.176852 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.180927 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1321/2649] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:16.192335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.193685 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:16.206285 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1329/2650] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:37:16 2021] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:37:16.207980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.219009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41fb6d-9e87-4c7d-a804-8d1a90ae577f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.225817 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.226507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.226781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.227239 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.228785 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.230700 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.250516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1330/2651] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:16.251769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.263668 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33fe7a-36c1-4852-8557-6998926ec38e None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.264463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76715273-5380-4a51-9ad5-93c67930b291 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.268506 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.269562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.270035 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.270426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.270687 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.271583 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.271869 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.272157 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] PATH_INFO: `/v3/projects/508ead0319f54eee9701b6bee2d11cd0/users/e3dd6ee3728b4d6fb85a11ed8c5658c0/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.286919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.289385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=508ead0319f54eee9701b6bee2d11cd0, user_id=e3dd6ee3728b4d6fb85a11ed8c5658c0, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.291694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.292102 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.312530 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1331/2652] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:16 2021] PUT /identity/v3/projects/508ead0319f54eee9701b6bee2d11cd0/users/e3dd6ee3728b4d6fb85a11ed8c5658c0/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:16.320675 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.323746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1322/2653] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:16 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:37:16.425302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298a40b-a700-40e6-b6a5-ad59ee40d92b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.433174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d193927-3d14-49b5-b9cf-e81a4fe3d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.433871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193927-3d14-49b5-b9cf-e81a4fe3d893 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.434150 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193927-3d14-49b5-b9cf-e81a4fe3d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.434423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193927-3d14-49b5-b9cf-e81a4fe3d893 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.435178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d193927-3d14-49b5-b9cf-e81a4fe3d893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.436910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d193927-3d14-49b5-b9cf-e81a4fe3d893 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.448639 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1332/2654] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:37:16.453781 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.465798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2bff-d8b8-4fbf-bfb5-9d39fc7f6941 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.471581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.472500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.472790 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.473223 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] PATH_INFO: `/v3/projects/508ead0319f54eee9701b6bee2d11cd0/users/e3dd6ee3728b4d6fb85a11ed8c5658c0/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.475343 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508ead0319f54eee9701b6bee2d11cd0, user_id=e3dd6ee3728b4d6fb85a11ed8c5658c0, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.478331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.491238 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1323/2655] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:37:16 2021] PUT /identity/v3/projects/508ead0319f54eee9701b6bee2d11cd0/users/e3dd6ee3728b4d6fb85a11ed8c5658c0/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:16.501826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4cfd-5227-429a-ae9e-89b633aa047c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.502148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4cfd-5227-429a-ae9e-89b633aa047c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.502460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4cfd-5227-429a-ae9e-89b633aa047c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.531858 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a7fa4cfd-5227-429a-ae9e-89b633aa047c None None] MFA Rules not processed for user `e3dd6ee3728b4d6fb85a11ed8c5658c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:16.533209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a7fa4cfd-5227-429a-ae9e-89b633aa047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:16.630136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1333/2656] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:16 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:16.637740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.704092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2115-9011-4e3b-a279-43e9f528d433 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.709353 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b766142-6c1c-4a74-8fd4-04718daea643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.710599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b766142-6c1c-4a74-8fd4-04718daea643 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.710903 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b766142-6c1c-4a74-8fd4-04718daea643 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.711192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b766142-6c1c-4a74-8fd4-04718daea643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.725232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b766142-6c1c-4a74-8fd4-04718daea643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.726767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b766142-6c1c-4a74-8fd4-04718daea643 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.738037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1324/2657] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:16 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:16.827695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4cfd-5227-429a-ae9e-89b633aa047c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:16.839025 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4cfd-5227-429a-ae9e-89b633aa047c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:16.844648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:16.845230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:16.845515 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:16.845860 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:16.915149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:16.916826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:16.935578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1334/2658] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:16 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:17.730202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3007b-ad55-403e-92de-6d0f72980c31 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:17.730735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3007b-ad55-403e-92de-6d0f72980c31 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:17.730735 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3007b-ad55-403e-92de-6d0f72980c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:17.750056 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1af3007b-ad55-403e-92de-6d0f72980c31 None None] MFA Rules not processed for user `aadbda5d4102494897e11f6818d4ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:17.751608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1af3007b-ad55-403e-92de-6d0f72980c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:17.819399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1325/2659] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:17 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:21.290320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:21.292022 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:21.365185 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbcd2e-37cf-456b-8de1-d2f9ad756e59 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:21.370169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:21.371083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:21.371362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:21.371658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] PATH_INFO: `/v3/users/8b241530f5bd4149a6dca50a1bd023e1` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:21.372883 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b241530f5bd4149a6dca50a1bd023e1)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:21.375202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:21.423035 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b241530f5bd4149a6dca50a1bd023e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.435624 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b241530f5bd4149a6dca50a1bd023e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.443747 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b241530f5bd4149a6dca50a1bd023e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.444579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b241530f5bd4149a6dca50a1bd023e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.453061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b241530f5bd4149a6dca50a1bd023e1'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.461343 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1335/2660] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:21 2021] DELETE /identity/v3/users/8b241530f5bd4149a6dca50a1bd023e1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:21.644004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3007b-ad55-403e-92de-6d0f72980c31 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:21.674058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3007b-ad55-403e-92de-6d0f72980c31 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:21.734411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:21.735278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:21.735592 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:21.735975 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] PATH_INFO: `/v3/projects/c24d36ba6b374775b93c113837910ba6` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:21.737052 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24d36ba6b374775b93c113837910ba6)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:21.738992 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:21.785793 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24d36ba6b374775b93c113837910ba6', 'request_id': 'req-9e71de76-26d3-44a8-89e5-76073efc03a4'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.791840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24d36ba6b374775b93c113837910ba6', 'request_id': 'req-9e71de76-26d3-44a8-89e5-76073efc03a4'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.797402 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24d36ba6b374775b93c113837910ba6', 'request_id': 'req-9e71de76-26d3-44a8-89e5-76073efc03a4'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.810977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] The token cache is being invalidate because project c24d36ba6b374775b93c113837910ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:21.811304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.812041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.813672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1326/2661] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:21 2021] DELETE /identity/v3/projects/c24d36ba6b374775b93c113837910ba6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:21.817642 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:21.819330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:21.833290 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd951e-9a26-44c0-b799-883a0ba8ccca admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:21.894111 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:21.895103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:21.895521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:21.895871 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] PATH_INFO: `/v3/users/5dcaa808a2524e33a1630185ba8d3ca8` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:21.902350 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcaa808a2524e33a1630185ba8d3ca8)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:21.904513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:21.964193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcaa808a2524e33a1630185ba8d3ca8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.979516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcaa808a2524e33a1630185ba8d3ca8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.987644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcaa808a2524e33a1630185ba8d3ca8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.988410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcaa808a2524e33a1630185ba8d3ca8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:21.996427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcaa808a2524e33a1630185ba8d3ca8'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:22.003122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1336/2662] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:37:21 2021] DELETE /identity/v3/users/5dcaa808a2524e33a1630185ba8d3ca8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:22.182304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:22.183877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:22.198673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71de76-26d3-44a8-89e5-76073efc03a4 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:22.256044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:22.256877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:22.257154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:22.257458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] PATH_INFO: `/v3/projects/90a380b1f3c4481cba1e2dbeb03314e8` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:22.258620 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a380b1f3c4481cba1e2dbeb03314e8)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:22.260537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:22.306431 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a380b1f3c4481cba1e2dbeb03314e8', 'request_id': 'req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:22.312863 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a380b1f3c4481cba1e2dbeb03314e8', 'request_id': 'req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:22.318565 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a380b1f3c4481cba1e2dbeb03314e8', 'request_id': 'req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:22.332625 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] The token cache is being invalidate because project 90a380b1f3c4481cba1e2dbeb03314e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:37:22.332907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:22.333576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8f2530f5-6af9-4f3e-b6cc-4c57b43bf13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:37:22.335484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1327/2663] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:37:22 2021] DELETE /identity/v3/projects/90a380b1f3c4481cba1e2dbeb03314e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:37:25.688009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:25.689632 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:25.763203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0cbb7-3858-45b4-910d-5132d6d9930f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:25.825998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8eb83-e01b-449e-a4a7-2f22e026bf42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:25.826650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8eb83-e01b-449e-a4a7-2f22e026bf42 service placement] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:25.827044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8eb83-e01b-449e-a4a7-2f22e026bf42 service placement] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:25.827537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8eb83-e01b-449e-a4a7-2f22e026bf42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:25.829616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a7b8eb83-e01b-449e-a4a7-2f22e026bf42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:25.842353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8eb83-e01b-449e-a4a7-2f22e026bf42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:25.844133 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8eb83-e01b-449e-a4a7-2f22e026bf42 service placement] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:25.854810 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1337/2664] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:37:25 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:37:32.622585 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:32.623110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:32.623203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:32.641459 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] MFA Rules not processed for user `aadbda5d4102494897e11f6818d4ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:32.642673 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:32.705788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1328/2665] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:37:32 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:51.715241 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf5b4-2699-4b2c-8f85-68ca274c06fc None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:51.715926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf5b4-2699-4b2c-8f85-68ca274c06fc None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:51.715926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bf5b4-2699-4b2c-8f85-68ca274c06fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:51.735853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-137bf5b4-2699-4b2c-8f85-68ca274c06fc None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:37:51.737077 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-137bf5b4-2699-4b2c-8f85-68ca274c06fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:51.794654 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1338/2666] 10.222.0.58 () {58 vars in 1010 bytes} [Fri Aug 27 03:37:51 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:37:51.808911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:37:51.810439 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:37:51.887529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ed993-88f4-4d98-b33b-099f6af7d758 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:37:51.893215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:37:51.893879 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:37:51.894647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:37:51.894647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:37:51.904757 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:37:51.906366 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:37:51.914938 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1329/2667] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:37:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:07.356178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:07.356914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:07.356914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:07.376281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] MFA Rules not processed for user `0d95b35088f34ce3b36e94f47ef389c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:38:07.377630 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:07.385514 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1339/2668] 10.222.0.58 () {58 vars in 968 bytes} [Fri Aug 27 03:38:07 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:38:07.399435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:07.411553 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40046-8a6b-4dbf-925e-c7df37f7e030 service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:07.417662 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9170b262488467fad0bf6aad8d3814a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:07.418389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:07.418663 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:07.418928 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:07.428447 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:07.430085 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:07.439108 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1330/2669] 10.222.0.58 () {60 vars in 1385 bytes} [Fri Aug 27 03:38:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:09.420207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:09.421795 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:09.502240 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104a5ae-0958-46d9-aea3-27c4bbcf5aa8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:09.508200 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:09.509075 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:09.509330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:09.509616 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] PATH_INFO: `/v3/users/aadbda5d4102494897e11f6818d4ca4a` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:09.510952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadbda5d4102494897e11f6818d4ca4a)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:09.512959 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:09.563305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadbda5d4102494897e11f6818d4ca4a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.576415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadbda5d4102494897e11f6818d4ca4a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.583226 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadbda5d4102494897e11f6818d4ca4a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.583992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadbda5d4102494897e11f6818d4ca4a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.592468 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-bba62c46-1ce8-48d6-9622-74716242a022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadbda5d4102494897e11f6818d4ca4a'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.598670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1340/2670] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:38:09 2021] DELETE /identity/v3/users/aadbda5d4102494897e11f6818d4ca4a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:38:09.779671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:09.792317 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12725daa-216b-426b-8361-a4743afc3d5c service swift] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:09.853901 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:09.854769 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:09.855050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:09.855324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] PATH_INFO: `/v3/projects/87c503a5f4c94ed5a5d883191cf39692` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:09.856848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c503a5f4c94ed5a5d883191cf39692)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:09.858768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:09.911575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c503a5f4c94ed5a5d883191cf39692', 'request_id': 'req-4bd9d655-2c04-4e5d-97d8-95b17deddae1'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.917672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c503a5f4c94ed5a5d883191cf39692', 'request_id': 'req-4bd9d655-2c04-4e5d-97d8-95b17deddae1'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.923042 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c503a5f4c94ed5a5d883191cf39692', 'request_id': 'req-4bd9d655-2c04-4e5d-97d8-95b17deddae1'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.936289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] The token cache is being invalidate because project 87c503a5f4c94ed5a5d883191cf39692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:38:09.936605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.937332 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4bd9d655-2c04-4e5d-97d8-95b17deddae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:09.938920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1331/2671] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:38:09 2021] DELETE /identity/v3/projects/87c503a5f4c94ed5a5d883191cf39692 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:38:09.945796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739c8f-7b94-4c11-a401-5c46ba24606b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:09.946152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739c8f-7b94-4c11-a401-5c46ba24606b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:09.946516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739c8f-7b94-4c11-a401-5c46ba24606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:09.967263 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-62739c8f-7b94-4c11-a401-5c46ba24606b None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:38:09.969311 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-62739c8f-7b94-4c11-a401-5c46ba24606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:10.041594 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1341/2672] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:38:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:38:10.050089 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbc636-6583-4188-b1dd-884cd5cc2286 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.050385 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbc636-6583-4188-b1dd-884cd5cc2286 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.050660 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbc636-6583-4188-b1dd-884cd5cc2286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.073091 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-e0cbc636-6583-4188-b1dd-884cd5cc2286 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:38:10.074324 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e0cbc636-6583-4188-b1dd-884cd5cc2286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:10.084433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1332/2673] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:38:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:38:10.088960 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739c8f-7b94-4c11-a401-5c46ba24606b None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.099304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739c8f-7b94-4c11-a401-5c46ba24606b None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.104362 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.105006 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.105342 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.105601 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.106378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:38:10.106636 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.108302 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.120696 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1342/2674] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:38:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:38:10.127649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbc636-6583-4188-b1dd-884cd5cc2286 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.142711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbc636-6583-4188-b1dd-884cd5cc2286 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.150825 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.151591 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.151954 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.152236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.153224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.155249 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.189615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1333/2675] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:38:10 2021] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:38:10.193742 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.204384 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978de9-2f82-477f-afc7-9738a87d853b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.268951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.269614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.269895 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.270170 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.270885 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.272814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.296304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1343/2676] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:38:10 2021] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:38:10.300990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.312523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e299129-5ad6-4f70-aadf-c1a7728d8791 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.318360 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.319024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.319307 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.319617 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.320384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.322031 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.333311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1334/2677] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:38:10 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:38:10.337975 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.349071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75548a-534c-4a4e-8368-bf7194195e00 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.354410 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e386dbb-1a15-4063-982d-98ca5fb02fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.355071 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386dbb-1a15-4063-982d-98ca5fb02fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.355369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386dbb-1a15-4063-982d-98ca5fb02fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.355658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e386dbb-1a15-4063-982d-98ca5fb02fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.356473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e386dbb-1a15-4063-982d-98ca5fb02fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.358099 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e386dbb-1a15-4063-982d-98ca5fb02fc3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.368481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1344/2678] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:38:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:38:10.372997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.383680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0875-3e82-483e-8046-c7e4f66ee83f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.389186 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.390088 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.390355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.390638 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] PATH_INFO: `/v3/projects/420fffa89c1f41c3a1fe538d41830bae/users/14a850b4e1df404ba426bf0b022a69ac/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.406001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420fffa89c1f41c3a1fe538d41830bae, user_id=14a850b4e1df404ba426bf0b022a69ac, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.408716 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.422748 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1335/2679] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:38:10 2021] PUT /identity/v3/projects/420fffa89c1f41c3a1fe538d41830bae/users/14a850b4e1df404ba426bf0b022a69ac/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:38:10.433024 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1b29-69d8-4631-973e-2e05ffd705f0 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.433521 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1b29-69d8-4631-973e-2e05ffd705f0 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.433633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1b29-69d8-4631-973e-2e05ffd705f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.460163 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-441f1b29-69d8-4631-973e-2e05ffd705f0 None None] MFA Rules not processed for user `14a850b4e1df404ba426bf0b022a69ac`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:38:10.461404 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-441f1b29-69d8-4631-973e-2e05ffd705f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:10.526103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1345/2680] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:38:10 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:38:10.537471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.539711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:10.612367 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9093d-a5a1-4e2e-a594-4db2159ee5f6 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.616940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dc89a-5f80-4516-b484-3d40aa886ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.617593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dc89a-5f80-4516-b484-3d40aa886ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.617872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dc89a-5f80-4516-b484-3d40aa886ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.618141 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dc89a-5f80-4516-b484-3d40aa886ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.627435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dc89a-5f80-4516-b484-3d40aa886ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.628877 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dc89a-5f80-4516-b484-3d40aa886ef5 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.638065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1336/2681] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:38:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:38:10.666381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1b29-69d8-4631-973e-2e05ffd705f0 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.741705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1b29-69d8-4631-973e-2e05ffd705f0 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:10.747043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:10.747998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.748281 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.748552 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] PATH_INFO: `/v3/users/14a850b4e1df404ba426bf0b022a69ac` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.749779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a850b4e1df404ba426bf0b022a69ac)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:10.751712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:10.799329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a850b4e1df404ba426bf0b022a69ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:10.812166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a850b4e1df404ba426bf0b022a69ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:10.819545 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a850b4e1df404ba426bf0b022a69ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:10.820352 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a850b4e1df404ba426bf0b022a69ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:10.830709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a850b4e1df404ba426bf0b022a69ac'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:10.839760 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1346/2682] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:38:10 2021] DELETE /identity/v3/users/14a850b4e1df404ba426bf0b022a69ac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:38:10.845120 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:10.845659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:10.845659 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:10.864343 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:38:10.865501 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:10.940832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1337/2683] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:38:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:38:10.955013 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:10.957602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:11.035886 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b591-1c26-46b3-aebc-cad40fe4a3f3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:11.042746 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:11.043720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:11.044001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:11.044314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:11.058060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:11.059924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:11.070769 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1347/2684] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:38:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:38:11.370977 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:38:11.371801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:38:11.386003 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545f9a-40b3-4ed9-b1c4-204d400b33ac None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:38:11.396806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:38:11.397832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:38:11.398110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:38:11.398378 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] PATH_INFO: `/v3/projects/420fffa89c1f41c3a1fe538d41830bae` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:38:11.399645 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] RBAC: Authorizing `identity:delete_project(project_id=420fffa89c1f41c3a1fe538d41830bae)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:38:11.401635 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:38:11.466550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420fffa89c1f41c3a1fe538d41830bae', 'request_id': 'req-4f06244f-d706-4e88-970a-316d9703332b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:11.473070 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420fffa89c1f41c3a1fe538d41830bae', 'request_id': 'req-4f06244f-d706-4e88-970a-316d9703332b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:11.478963 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420fffa89c1f41c3a1fe538d41830bae', 'request_id': 'req-4f06244f-d706-4e88-970a-316d9703332b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:11.495846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] The token cache is being invalidate because project 420fffa89c1f41c3a1fe538d41830bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:38:11.496252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:11.497351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:38:11.499898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1338/2685] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:38:11 2021] DELETE /identity/v3/projects/420fffa89c1f41c3a1fe538d41830bae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:42:17.684222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:42:17.685841 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:42:17.783946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d050b8-c19d-4cad-b531-09a269ff1d2f service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:42:17.859375 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:42:17.860061 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:42:17.860353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:42:17.860648 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:42:17.862899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:42:17.953319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:42:17.955426 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:42:17.970522 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1348/2686] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:42:17 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:42:31.699873 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:42:31.702185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:42:31.834152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06244f-d706-4e88-970a-316d9703332b admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:42:31.840546 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:42:31.841191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:42:31.841454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:42:31.841733 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:42:31.843856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:42:31.856093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:42:31.857709 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:42:31.868573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1339/2687] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:42:31 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:19.736833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:19.738438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:19.774833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753c1f5-64e1-45e1-ab1d-c704d3820777 service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:19.778947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a868df-d09f-4971-9152-8a3216d3e8fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:19.779633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a868df-d09f-4971-9152-8a3216d3e8fb service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:19.779935 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a868df-d09f-4971-9152-8a3216d3e8fb service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:19.780203 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a868df-d09f-4971-9152-8a3216d3e8fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:19.782278 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-86a868df-d09f-4971-9152-8a3216d3e8fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:19.860604 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a868df-d09f-4971-9152-8a3216d3e8fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:19.861496 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a868df-d09f-4971-9152-8a3216d3e8fb service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:19.871378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1349/2688] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:19 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:20.030559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:20.032114 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:20.145731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5232a3-832e-429c-88db-abb9adf06bb8 service placement] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:20.151205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:20.152146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:20.152429 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:20.152708 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] PATH_INFO: `/v3/users/18df39c351c044dcb0716a8595da83fb` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:20.153969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18df39c351c044dcb0716a8595da83fb)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:20.156756 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:20.211516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18df39c351c044dcb0716a8595da83fb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.219896 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18df39c351c044dcb0716a8595da83fb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.220679 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18df39c351c044dcb0716a8595da83fb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.232755 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18df39c351c044dcb0716a8595da83fb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.233702 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18df39c351c044dcb0716a8595da83fb'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.247780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1340/2689] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:20 2021] DELETE /identity/v3/users/18df39c351c044dcb0716a8595da83fb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:20.252854 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:20.253144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:20.253421 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:20.279962 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:20.281189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:20.341781 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1350/2690] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:20.354022 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:20.355561 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:20.437770 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361c92-ea88-40ac-a69e-dce40c779a4f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:20.442907 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:20.444033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:20.444577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:20.444869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:20.455405 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:20.456946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:20.467301 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1341/2691] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:43:20.752543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:20.754276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:20.766910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dfd8e-0cd3-46d3-914c-c40a49d85eb1 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:20.772427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:20.773836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:20.774121 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:20.774393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] PATH_INFO: `/v3/projects/433c3bae81f74614ad0c1296860046a9` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:20.775714 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] RBAC: Authorizing `identity:delete_project(project_id=433c3bae81f74614ad0c1296860046a9)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:20.777633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:20.827565 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433c3bae81f74614ad0c1296860046a9', 'request_id': 'req-5dc7a0d6-52c7-4943-96fe-257c9194186e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.837168 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433c3bae81f74614ad0c1296860046a9', 'request_id': 'req-5dc7a0d6-52c7-4943-96fe-257c9194186e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.848828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433c3bae81f74614ad0c1296860046a9', 'request_id': 'req-5dc7a0d6-52c7-4943-96fe-257c9194186e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.860501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] The token cache is being invalidate because project 433c3bae81f74614ad0c1296860046a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:20.860783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.861407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:20.863095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1351/2692] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:20 2021] DELETE /identity/v3/projects/433c3bae81f74614ad0c1296860046a9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:20.867484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:20.878154 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509927f4-8bf5-4a4f-9b71-d39e1db779fd service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:20.939290 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:20.940222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:20.940505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:20.940784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] PATH_INFO: `/v3/users/e3dd6ee3728b4d6fb85a11ed8c5658c0` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:20.942046 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dd6ee3728b4d6fb85a11ed8c5658c0)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:20.944015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:20.993327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dd6ee3728b4d6fb85a11ed8c5658c0'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.000053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dd6ee3728b4d6fb85a11ed8c5658c0'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.000740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dd6ee3728b4d6fb85a11ed8c5658c0'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.012077 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dd6ee3728b4d6fb85a11ed8c5658c0'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.012813 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-00adc3b1-f847-47f1-b534-139761acd6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dd6ee3728b4d6fb85a11ed8c5658c0'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.027029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1342/2693] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:20 2021] DELETE /identity/v3/users/e3dd6ee3728b4d6fb85a11ed8c5658c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:21.323834 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:21.325439 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:21.339210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7a0d6-52c7-4943-96fe-257c9194186e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:21.396411 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:21.397284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.397563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.397836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] PATH_INFO: `/v3/projects/508ead0319f54eee9701b6bee2d11cd0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.399033 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=508ead0319f54eee9701b6bee2d11cd0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:21.401007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:21.454076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508ead0319f54eee9701b6bee2d11cd0', 'request_id': 'req-55a9290e-3f4d-4169-9010-b3be8fd7b37e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.460546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508ead0319f54eee9701b6bee2d11cd0', 'request_id': 'req-55a9290e-3f4d-4169-9010-b3be8fd7b37e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.470377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508ead0319f54eee9701b6bee2d11cd0', 'request_id': 'req-55a9290e-3f4d-4169-9010-b3be8fd7b37e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.486818 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] The token cache is being invalidate because project 508ead0319f54eee9701b6bee2d11cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:21.487112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.487775 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-55a9290e-3f4d-4169-9010-b3be8fd7b37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:21.489374 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1352/2694] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:21 2021] DELETE /identity/v3/projects/508ead0319f54eee9701b6bee2d11cd0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:21.497758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183ab3-9858-4ed6-9f74-23679b60644a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.498260 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183ab3-9858-4ed6-9f74-23679b60644a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.498379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183ab3-9858-4ed6-9f74-23679b60644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.548355 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5d183ab3-9858-4ed6-9f74-23679b60644a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:21.549477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5d183ab3-9858-4ed6-9f74-23679b60644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:21.610374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1343/2695] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:21.623397 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83170-56a4-4f58-adb3-b873f613b517 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.623793 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83170-56a4-4f58-adb3-b873f613b517 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.624144 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83170-56a4-4f58-adb3-b873f613b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.643194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-b7c83170-56a4-4f58-adb3-b873f613b517 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:21.644435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-b7c83170-56a4-4f58-adb3-b873f613b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:21.652751 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1353/2696] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:21.657293 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183ab3-9858-4ed6-9f74-23679b60644a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:21.667005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183ab3-9858-4ed6-9f74-23679b60644a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:21.672116 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:21.672765 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.673041 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.673318 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.674021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:21.674349 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:21.676338 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:21.687906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1344/2697] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:43:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:21.692966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83170-56a4-4f58-adb3-b873f613b517 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:21.707806 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83170-56a4-4f58-adb3-b873f613b517 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:21.716727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:21.717758 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.718044 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.718303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.718992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:21.721000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:21.753306 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1354/2698] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:21 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:21.759093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:21.774936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6b510-0da1-4b7c-9606-7fdbfe2b8291 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:21.846008 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:21.846703 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.847034 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.847314 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.848149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:21.850140 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:21.875166 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1345/2699] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:21 2021] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:21.881615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:21.895964 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b965-2820-42e7-b5d9-e53dbcdcf7a6 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:21.901702 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:21.902396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.902678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.903003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.903752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:21.905354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:21.916394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1355/2700] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:21.922048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:21.932785 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bed6e-cc78-48ce-bb16-253e6082a7c0 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:21.939021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2687731-2513-41de-97d5-0746c7f6f7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:21.939736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687731-2513-41de-97d5-0746c7f6f7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.940015 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687731-2513-41de-97d5-0746c7f6f7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.940283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2687731-2513-41de-97d5-0746c7f6f7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.941006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2687731-2513-41de-97d5-0746c7f6f7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:21.942642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2687731-2513-41de-97d5-0746c7f6f7a3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:21.956013 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1346/2701] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:43:21.960328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:21.971276 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78ffc0-8e2c-49a9-b9d0-cf3eb7710600 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:21.976638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:21.977548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:21.977825 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:21.978095 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] PATH_INFO: `/v3/projects/1a8b76af80f04d4abbb8462ac8c12fe8/users/c3ab5b216fc74c3b94ae0d8b3aaeabc7/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:21.993932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8b76af80f04d4abbb8462ac8c12fe8, user_id=c3ab5b216fc74c3b94ae0d8b3aaeabc7, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:21.998353 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.018670 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1356/2702] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:21 2021] PUT /identity/v3/projects/1a8b76af80f04d4abbb8462ac8c12fe8/users/c3ab5b216fc74c3b94ae0d8b3aaeabc7/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:22.029498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218df5b-7847-4eab-9001-51f124f5009b None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.029798 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218df5b-7847-4eab-9001-51f124f5009b None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.030096 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218df5b-7847-4eab-9001-51f124f5009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.058543 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-5218df5b-7847-4eab-9001-51f124f5009b None None] MFA Rules not processed for user `c3ab5b216fc74c3b94ae0d8b3aaeabc7`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:22.059868 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-5218df5b-7847-4eab-9001-51f124f5009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:22.143079 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1347/2703] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:22 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:22.148062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.212057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f13cc-f4aa-4a40-8f08-ed05161a941d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.218524 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.219233 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.219539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.219807 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.220501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.222459 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.250851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1357/2704] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:22 2021] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:22.255196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218df5b-7847-4eab-9001-51f124f5009b None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.267421 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218df5b-7847-4eab-9001-51f124f5009b None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.325718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.326387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.326642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.326935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.327933 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.329606 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.352264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1348/2705] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:22 2021] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:22.356473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.371190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e74e-6734-4b2a-ac01-b53c2d4a4cfd admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.377323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.378037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.378319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.378597 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.379394 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.381011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.393794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1358/2706] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:22 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:22.397918 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.409436 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca701b0-96f1-44f7-9828-424fd7cebd5c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.415401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.416348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.416626 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.416898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] PATH_INFO: `/v3/projects/bde537797d2b4273a464083c1d437ea0/users/d88fdcaa84514ebe96e13c793e39218a/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.433496 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde537797d2b4273a464083c1d437ea0, user_id=d88fdcaa84514ebe96e13c793e39218a, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.436423 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.453098 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1349/2707] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:22 2021] PUT /identity/v3/projects/bde537797d2b4273a464083c1d437ea0/users/d88fdcaa84514ebe96e13c793e39218a/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:22.459949 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.473357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bc054-b493-4138-9e70-e3023babf21a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.538346 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ddbd6-09dc-49ea-8b3d-9acb916341e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.539014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddbd6-09dc-49ea-8b3d-9acb916341e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.539293 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddbd6-09dc-49ea-8b3d-9acb916341e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.539614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ddbd6-09dc-49ea-8b3d-9acb916341e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.540305 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ddbd6-09dc-49ea-8b3d-9acb916341e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.541905 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ddbd6-09dc-49ea-8b3d-9acb916341e5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.552029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1359/2708] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:22 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:22.558252 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.570270 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629d8cf-86fd-4749-a839-047741554edb admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.576351 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.577263 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.577537 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.577892 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] PATH_INFO: `/v3/projects/bde537797d2b4273a464083c1d437ea0/users/d88fdcaa84514ebe96e13c793e39218a/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.580038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde537797d2b4273a464083c1d437ea0, user_id=d88fdcaa84514ebe96e13c793e39218a, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.582786 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.594771 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1350/2709] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:22 2021] PUT /identity/v3/projects/bde537797d2b4273a464083c1d437ea0/users/d88fdcaa84514ebe96e13c793e39218a/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:22.606174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.606463 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.606741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.634188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] MFA Rules not processed for user `d88fdcaa84514ebe96e13c793e39218a`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:22.635336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:22.707890 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1360/2710] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:22 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:22.719869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.723230 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:22.795722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f5d84-8dba-472f-b331-c31f01567fb2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.801644 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.802319 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.802602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.802876 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.813655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.815148 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.825055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1351/2711] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:22 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:22.875495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:22.877606 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:22.895506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d532f-f83b-4f2d-9fcf-1e3619566dfa None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:22.900179 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d87171-60f4-42a8-a50c-81441871d56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:22.900826 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d87171-60f4-42a8-a50c-81441871d56b service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:22.901103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d87171-60f4-42a8-a50c-81441871d56b service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:22.901368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d87171-60f4-42a8-a50c-81441871d56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:22.972167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d87171-60f4-42a8-a50c-81441871d56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:22.973678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d87171-60f4-42a8-a50c-81441871d56b service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:22.982765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1361/2712] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:22 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:26.350396 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:26.424562 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333097a-5acb-4c22-bb66-0c1d1704cf90 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:26.429867 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:26.430751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:26.431029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:26.431300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] PATH_INFO: `/v3/users/c3ab5b216fc74c3b94ae0d8b3aaeabc7` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:26.432520 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3ab5b216fc74c3b94ae0d8b3aaeabc7)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:26.434449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:26.485484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3ab5b216fc74c3b94ae0d8b3aaeabc7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:26.492650 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3ab5b216fc74c3b94ae0d8b3aaeabc7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:26.493386 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3ab5b216fc74c3b94ae0d8b3aaeabc7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:26.506274 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3ab5b216fc74c3b94ae0d8b3aaeabc7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:26.506932 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3ab5b216fc74c3b94ae0d8b3aaeabc7'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:26.521196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1352/2713] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:26 2021] DELETE /identity/v3/users/c3ab5b216fc74c3b94ae0d8b3aaeabc7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:26.527005 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:26.527910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:26.527910 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:26.553206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:26.554401 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:26.620115 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1362/2714] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:26.631198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:26.633146 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:26.697729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8f43-2964-4679-9bf5-2b1687af928a admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:26.703163 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:26.703860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:26.704144 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:26.704384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:26.714118 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:26.715614 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:26.725424 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1353/2715] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:27.024738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:27.026254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:27.039615 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f5416-7586-44ed-8d60-53d32c149227 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:27.045065 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:27.045923 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:27.046202 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:27.046473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] PATH_INFO: `/v3/projects/1a8b76af80f04d4abbb8462ac8c12fe8` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:27.047880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8b76af80f04d4abbb8462ac8c12fe8)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:27.050367 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:27.097017 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8b76af80f04d4abbb8462ac8c12fe8', 'request_id': 'req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.103430 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8b76af80f04d4abbb8462ac8c12fe8', 'request_id': 'req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.113238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8b76af80f04d4abbb8462ac8c12fe8', 'request_id': 'req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.128881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] The token cache is being invalidate because project 1a8b76af80f04d4abbb8462ac8c12fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:27.129355 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.130519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.133166 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1363/2716] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:27 2021] DELETE /identity/v3/projects/1a8b76af80f04d4abbb8462ac8c12fe8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:27.139744 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:27.151788 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee125ec3-aacb-47f4-a100-4aca727abff3 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:27.217890 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:27.218772 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:27.219049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:27.219315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] PATH_INFO: `/v3/users/d88fdcaa84514ebe96e13c793e39218a` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:27.220800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88fdcaa84514ebe96e13c793e39218a)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:27.222758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:27.278579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88fdcaa84514ebe96e13c793e39218a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.289038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88fdcaa84514ebe96e13c793e39218a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.290037 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88fdcaa84514ebe96e13c793e39218a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.306389 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88fdcaa84514ebe96e13c793e39218a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.307442 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4ca05e75-4ac0-4a52-ab0a-b1d85e371517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88fdcaa84514ebe96e13c793e39218a'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.324320 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1354/2717] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:27 2021] DELETE /identity/v3/users/d88fdcaa84514ebe96e13c793e39218a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:27.617851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:27.619337 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:27.632555 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744ee0-ed5b-4224-a816-b85a9fa8c2f7 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:27.690958 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:27.691900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:27.692184 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:27.692437 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] PATH_INFO: `/v3/projects/bde537797d2b4273a464083c1d437ea0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:27.693796 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde537797d2b4273a464083c1d437ea0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:27.695814 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:27.743864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde537797d2b4273a464083c1d437ea0', 'request_id': 'req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.749999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde537797d2b4273a464083c1d437ea0', 'request_id': 'req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.758118 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde537797d2b4273a464083c1d437ea0', 'request_id': 'req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.768062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] The token cache is being invalidate because project bde537797d2b4273a464083c1d437ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:27.768348 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.768967 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-83d2d3e1-125c-4932-a2e2-3b84a0715fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:27.770507 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1364/2718] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:27 2021] DELETE /identity/v3/projects/bde537797d2b4273a464083c1d437ea0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:43:27.776714 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77e0c-5285-44da-8fce-ea1ae0dc478a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:27.777225 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77e0c-5285-44da-8fce-ea1ae0dc478a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:27.777331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c77e0c-5285-44da-8fce-ea1ae0dc478a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:27.795838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-a1c77e0c-5285-44da-8fce-ea1ae0dc478a None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:27.797078 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-a1c77e0c-5285-44da-8fce-ea1ae0dc478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:27.858437 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1355/2719] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:27.866843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab35a-d713-4c3f-a976-76730ec6357c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:27.867127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab35a-d713-4c3f-a976-76730ec6357c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:27.867407 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ab35a-d713-4c3f-a976-76730ec6357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:27.886823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-386ab35a-d713-4c3f-a976-76730ec6357c None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:27.888039 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-386ab35a-d713-4c3f-a976-76730ec6357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:27.896490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1365/2720] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:27.901005 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77e0c-5285-44da-8fce-ea1ae0dc478a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:27.914057 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c77e0c-5285-44da-8fce-ea1ae0dc478a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:27.920832 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:27.921505 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:27.921783 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:27.922055 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:27.922865 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:27.923961 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:27.925922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:27.938460 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1356/2721] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:43:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:27.943218 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ab35a-d713-4c3f-a976-76730ec6357c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:27.953633 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ab35a-d713-4c3f-a976-76730ec6357c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:27.959821 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:27.960503 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:27.960780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:27.961048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:27.961753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:27.963738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:27.994287 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1366/2722] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:27 2021] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:28.000509 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.010997 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be9c4e-b628-41f3-b4b7-e39550135e91 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.067063 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.067760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.068038 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.068311 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.069023 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.070944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.091856 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1357/2723] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:27 2021] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:28.096138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.106688 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec382c-bf82-4f80-9b18-d6a6501d09a1 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.111880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.112550 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.112829 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.113098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.113880 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.115600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.126709 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1367/2724] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:43:28.132149 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.142567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac66c7-25d5-49e4-a1c5-7244ca7c39d7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.147978 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481537b9-3f02-4428-9144-1a8bf5824d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.148639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481537b9-3f02-4428-9144-1a8bf5824d2f admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.148922 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481537b9-3f02-4428-9144-1a8bf5824d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.149189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481537b9-3f02-4428-9144-1a8bf5824d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.149951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481537b9-3f02-4428-9144-1a8bf5824d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.151622 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481537b9-3f02-4428-9144-1a8bf5824d2f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.162760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1358/2725] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:28.167754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.181206 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70cc01-639d-4230-be47-b1d3d8186cba admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.186980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.187946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.188215 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.188497 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] PATH_INFO: `/v3/projects/d30dece1af994660a7a49b608c664699/users/614f5cc469fd4647a633310176c1c8f5/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.206246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30dece1af994660a7a49b608c664699, user_id=614f5cc469fd4647a633310176c1c8f5, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.208928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.225921 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1368/2726] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:28 2021] PUT /identity/v3/projects/d30dece1af994660a7a49b608c664699/users/614f5cc469fd4647a633310176c1c8f5/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:28.237267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8276-9393-4441-a154-cf2f412615d5 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.237556 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8276-9393-4441-a154-cf2f412615d5 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.237836 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb8276-9393-4441-a154-cf2f412615d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.266002 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-8bcb8276-9393-4441-a154-cf2f412615d5 None None] MFA Rules not processed for user `614f5cc469fd4647a633310176c1c8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:28.267822 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8bcb8276-9393-4441-a154-cf2f412615d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:28.337780 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1359/2727] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:28 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:28.344427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.416751 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e8eb-40ec-450d-9d9c-0e80552356e4 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.422646 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.424007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.424292 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.424576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.425651 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.427587 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.459021 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1369/2728] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:28 2021] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:28.463248 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb8276-9393-4441-a154-cf2f412615d5 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.477375 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb8276-9393-4441-a154-cf2f412615d5 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.538370 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.539053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.540632 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.540914 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.541634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.543598 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.567534 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1360/2729] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:28 2021] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:28.573313 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.584182 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ba008-b3fd-43da-b7b5-0439b1bbf887 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.589260 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.590085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.590366 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.590634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.591415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.593027 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.604156 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1370/2730] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:28.608346 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.618835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27f81c-5ef6-4973-9d41-d1e4e248b0c3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.624200 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.625119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.625406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.625680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] PATH_INFO: `/v3/projects/5a74f89dd800402fb62a8f5b43af35c9/users/ecd91e7d236e4baebc4b238d442a499e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.640893 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a74f89dd800402fb62a8f5b43af35c9, user_id=ecd91e7d236e4baebc4b238d442a499e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.643791 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.659104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1361/2731] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:28 2021] PUT /identity/v3/projects/5a74f89dd800402fb62a8f5b43af35c9/users/ecd91e7d236e4baebc4b238d442a499e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:28.665189 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.678659 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba11c94-33aa-4704-a32e-61b208c39d8f admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.762198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ca8bf-8a4e-471b-b077-2bfaa088a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.762963 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca8bf-8a4e-471b-b077-2bfaa088a1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.763396 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca8bf-8a4e-471b-b077-2bfaa088a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.763780 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca8bf-8a4e-471b-b077-2bfaa088a1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.764899 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ca8bf-8a4e-471b-b077-2bfaa088a1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.767972 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ca8bf-8a4e-471b-b077-2bfaa088a1f4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.778542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1371/2732] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:28.785698 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.801646 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0f76-8795-4ec7-924b-37e8b9710055 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:28.807962 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:28.808874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.809157 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.809435 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] PATH_INFO: `/v3/projects/5a74f89dd800402fb62a8f5b43af35c9/users/ecd91e7d236e4baebc4b238d442a499e/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.811951 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a74f89dd800402fb62a8f5b43af35c9, user_id=ecd91e7d236e4baebc4b238d442a499e, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:28.814613 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:28.826984 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1362/2733] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:28 2021] PUT /identity/v3/projects/5a74f89dd800402fb62a8f5b43af35c9/users/ecd91e7d236e4baebc4b238d442a499e/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:28.842319 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e8530-872e-45cb-bc49-9332309d0643 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:28.842611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e8530-872e-45cb-bc49-9332309d0643 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:28.842907 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e8530-872e-45cb-bc49-9332309d0643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:28.870827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-f88e8530-872e-45cb-bc49-9332309d0643 None None] MFA Rules not processed for user `ecd91e7d236e4baebc4b238d442a499e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:28.872145 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f88e8530-872e-45cb-bc49-9332309d0643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:28.942996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1372/2734] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:28 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:28.958092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:28.960348 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:29.025473 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c23ce6-adbd-4bcb-bc7b-d3e2514c4188 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:29.032728 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf1196-3b15-4268-ba35-475184f03dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:29.033411 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf1196-3b15-4268-ba35-475184f03dfa service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:29.033692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf1196-3b15-4268-ba35-475184f03dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:29.033968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf1196-3b15-4268-ba35-475184f03dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:29.044647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf1196-3b15-4268-ba35-475184f03dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:29.046113 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf1196-3b15-4268-ba35-475184f03dfa service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:29.057029 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1363/2735] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:28 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:29.123792 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e8530-872e-45cb-bc49-9332309d0643 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:29.190050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e8530-872e-45cb-bc49-9332309d0643 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:29.195734 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:29.196638 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:29.196913 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:29.197193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] PATH_INFO: `/v3/users/614f5cc469fd4647a633310176c1c8f5` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:29.198516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614f5cc469fd4647a633310176c1c8f5)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:29.200474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:29.256694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614f5cc469fd4647a633310176c1c8f5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.271936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614f5cc469fd4647a633310176c1c8f5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.282089 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614f5cc469fd4647a633310176c1c8f5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.282865 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614f5cc469fd4647a633310176c1c8f5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.291273 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614f5cc469fd4647a633310176c1c8f5'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.297393 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1373/2736] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:29 2021] DELETE /identity/v3/users/614f5cc469fd4647a633310176c1c8f5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:29.302549 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:29.302835 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:29.303103 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:29.321709 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:29.322915 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:29.391642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1364/2737] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:29.402473 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:29.403998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:29.462644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b330c-3c63-468f-a75b-4a84d9ed6d80 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:29.466946 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:29.467643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:29.467933 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:29.468205 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:29.478192 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:29.479694 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:29.489378 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1374/2738] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:29.783388 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:29.785191 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:29.798334 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008f2c6-16b2-4147-8a03-4e2d0ccf5a69 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:29.804584 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:29.805458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:29.805742 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:29.806026 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] PATH_INFO: `/v3/projects/d30dece1af994660a7a49b608c664699` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:29.807221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30dece1af994660a7a49b608c664699)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:29.809189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:29.858516 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30dece1af994660a7a49b608c664699', 'request_id': 'req-cac96016-5590-4b34-8ba0-3a8e180ea328'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.865671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30dece1af994660a7a49b608c664699', 'request_id': 'req-cac96016-5590-4b34-8ba0-3a8e180ea328'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.871689 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30dece1af994660a7a49b608c664699', 'request_id': 'req-cac96016-5590-4b34-8ba0-3a8e180ea328'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.886554 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] The token cache is being invalidate because project d30dece1af994660a7a49b608c664699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:29.887019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.887691 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:29.889282 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1365/2739] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:29 2021] DELETE /identity/v3/projects/d30dece1af994660a7a49b608c664699 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:29.894076 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:29.904184 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440fca-baf2-430f-8e7f-a553da3e5a0b service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:29.968169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:29.969040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:29.969323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:29.969626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] PATH_INFO: `/v3/users/ecd91e7d236e4baebc4b238d442a499e` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:29.970874 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd91e7d236e4baebc4b238d442a499e)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:29.973223 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:30.031143 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd91e7d236e4baebc4b238d442a499e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.044823 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd91e7d236e4baebc4b238d442a499e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.058271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd91e7d236e4baebc4b238d442a499e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.059581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd91e7d236e4baebc4b238d442a499e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.072486 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-b7b2646e-6fcf-4cdd-9718-97bbbafe9ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd91e7d236e4baebc4b238d442a499e'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.078904 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1375/2740] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:29 2021] DELETE /identity/v3/users/ecd91e7d236e4baebc4b238d442a499e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:30.389119 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:30.391092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:30.406986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac96016-5590-4b34-8ba0-3a8e180ea328 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:30.466403 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:30.467294 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.467599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.467870 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] PATH_INFO: `/v3/projects/5a74f89dd800402fb62a8f5b43af35c9` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.469027 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a74f89dd800402fb62a8f5b43af35c9)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:30.470947 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:30.524155 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a74f89dd800402fb62a8f5b43af35c9', 'request_id': 'req-9b489ef4-3d08-4c14-8c43-5e052211a04b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.531694 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a74f89dd800402fb62a8f5b43af35c9', 'request_id': 'req-9b489ef4-3d08-4c14-8c43-5e052211a04b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.538198 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a74f89dd800402fb62a8f5b43af35c9', 'request_id': 'req-9b489ef4-3d08-4c14-8c43-5e052211a04b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.556972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] The token cache is being invalidate because project 5a74f89dd800402fb62a8f5b43af35c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:30.557335 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.558458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-9b489ef4-3d08-4c14-8c43-5e052211a04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:30.560415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1366/2741] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:30 2021] DELETE /identity/v3/projects/5a74f89dd800402fb62a8f5b43af35c9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:30.568543 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9507-bca4-41a5-9e3c-0a7cd808e91d None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.568928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9507-bca4-41a5-9e3c-0a7cd808e91d None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.569208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9507-bca4-41a5-9e3c-0a7cd808e91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.589598 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-aecc9507-bca4-41a5-9e3c-0a7cd808e91d None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:30.590827 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-aecc9507-bca4-41a5-9e3c-0a7cd808e91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:30.656778 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1376/2742] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:30.666315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e43917-58e7-4023-8a2b-046bc2a45cc9 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.666701 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e43917-58e7-4023-8a2b-046bc2a45cc9 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.667100 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e43917-58e7-4023-8a2b-046bc2a45cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.690016 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-83e43917-58e7-4023-8a2b-046bc2a45cc9 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:30.691304 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-83e43917-58e7-4023-8a2b-046bc2a45cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:30.700454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1367/2743] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:30.705000 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9507-bca4-41a5-9e3c-0a7cd808e91d None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:30.716140 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9507-bca4-41a5-9e3c-0a7cd808e91d None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:30.722178 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:30.722836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.723114 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.723379 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] PATH_INFO: `/v3/domains` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.724142 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:30.724443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:30.726070 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:30.739090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1377/2744] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:43:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:30.744065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e43917-58e7-4023-8a2b-046bc2a45cc9 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:30.754417 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e43917-58e7-4023-8a2b-046bc2a45cc9 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:30.760547 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:30.761205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.761462 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.761774 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.762472 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:30.764471 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:30.793254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1368/2745] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:30 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:30.799707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:30.817135 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057430bb-fd80-45fd-8186-ff1a60d6381d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:30.891805 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:30.892495 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.892779 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.893051 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.893791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:30.895766 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:30.920889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1378/2746] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:30 2021] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:30.922142 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:30.933093 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536dea2-0b82-476b-afd2-96241dc43233 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:30.937965 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:30.938623 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.939152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.939469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.940224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:30.941949 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:30.953076 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1369/2747] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:43:30.957014 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:30.967336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4f71-f48c-435f-a6e0-4f665a96b4b9 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:30.974087 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf872-16ab-4e45-b2f0-bdb4b8b1bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:30.974765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf872-16ab-4e45-b2f0-bdb4b8b1bdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:30.975048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf872-16ab-4e45-b2f0-bdb4b8b1bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:30.975318 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf872-16ab-4e45-b2f0-bdb4b8b1bdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:30.976083 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf872-16ab-4e45-b2f0-bdb4b8b1bdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:30.977691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf872-16ab-4e45-b2f0-bdb4b8b1bdf8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:30.988149 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1379/2748] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:30.992697 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.005084 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980c0b7-1e95-4d22-8bf1-6672871825e3 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.010800 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.011736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.012019 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.012297 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] PATH_INFO: `/v3/projects/fd585ad32f5240bcb045f616eb483f79/users/70fdeffd60864d3da3242a4e1e5dc0fc/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.027972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd585ad32f5240bcb045f616eb483f79, user_id=70fdeffd60864d3da3242a4e1e5dc0fc, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.030672 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.046996 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1370/2749] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:30 2021] PUT /identity/v3/projects/fd585ad32f5240bcb045f616eb483f79/users/70fdeffd60864d3da3242a4e1e5dc0fc/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:43:31.059846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f79186-adaf-4b4d-840f-704d3c981b4e None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.060146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f79186-adaf-4b4d-840f-704d3c981b4e None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.060425 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f79186-adaf-4b4d-840f-704d3c981b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.088109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-a9f79186-adaf-4b4d-840f-704d3c981b4e None None] MFA Rules not processed for user `70fdeffd60864d3da3242a4e1e5dc0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:31.089368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-a9f79186-adaf-4b4d-840f-704d3c981b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:31.163415 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1380/2750] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:31 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:31.168843 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.242001 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a17b06-d1d3-409f-8096-74408cc249dd admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.247467 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.248127 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.248413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.248688 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.249384 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.251328 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.280573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1371/2751] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:31 2021] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:31.286098 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f79186-adaf-4b4d-840f-704d3c981b4e None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.297605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f79186-adaf-4b4d-840f-704d3c981b4e None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.356719 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.357385 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.357665 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.357937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.358629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.360629 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.389008 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1381/2752] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:31 2021] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:31.390308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.401917 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711fcfa-4990-4cf6-b144-1ff249d3004f admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.407711 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.408390 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.408671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.408946 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.410325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.412071 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.423065 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1372/2753] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:31.427695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.437931 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e5cc5-59be-4812-815c-fa835003957b admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.443656 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bfbdd-3274-45f6-8353-9a6f63a71ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.444307 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfbdd-3274-45f6-8353-9a6f63a71ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.444567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfbdd-3274-45f6-8353-9a6f63a71ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.444833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfbdd-3274-45f6-8353-9a6f63a71ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.445548 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bfbdd-3274-45f6-8353-9a6f63a71ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.447128 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bfbdd-3274-45f6-8353-9a6f63a71ee9 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.456986 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1382/2754] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:31.461240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.471269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39f7f9-125d-4466-9aea-9838c1faed9e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.477331 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.478255 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.478526 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.478804 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] PATH_INFO: `/v3/projects/4fcc4edc244745aaa79926341fa2a7a6/users/97dd7df6793648cab31e5fe64526110b/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.494925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcc4edc244745aaa79926341fa2a7a6, user_id=97dd7df6793648cab31e5fe64526110b, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.497567 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.518773 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1373/2755] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:31 2021] PUT /identity/v3/projects/4fcc4edc244745aaa79926341fa2a7a6/users/97dd7df6793648cab31e5fe64526110b/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:43:31.534271 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fabb-5eda-445f-a33c-574f9d62840c None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.534900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fabb-5eda-445f-a33c-574f9d62840c None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.535050 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3fabb-5eda-445f-a33c-574f9d62840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.565596 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d0e3fabb-5eda-445f-a33c-574f9d62840c None None] MFA Rules not processed for user `97dd7df6793648cab31e5fe64526110b`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:31.567188 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d0e3fabb-5eda-445f-a33c-574f9d62840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:31.636992 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1383/2756] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:31 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:31.641898 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.701216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f2d0-cc8c-4772-b31e-7ee16ea83178 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.706215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.706900 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.707174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.707475 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] PATH_INFO: `/v3/projects` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.708180 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.710097 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.737538 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1374/2757] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:31 2021] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:31.743041 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fabb-5eda-445f-a33c-574f9d62840c None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.754613 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3fabb-5eda-445f-a33c-574f9d62840c None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.820015 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.820698 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.821009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.821251 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] PATH_INFO: `/v3/users` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.821951 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.823936 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.849879 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1384/2758] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:31 2021] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:31.854425 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.865454 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2fdd0-0622-45ad-ad14-31e56bbdec0d admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.871256 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.872009 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.872312 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.872616 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.873401 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.875128 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.886599 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1375/2759] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 03:43:31.891057 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.901357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6857b9-2770-4f34-8005-8d839141c1c8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:31.906736 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:31.907672 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:31.907950 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:31.908222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] PATH_INFO: `/v3/projects/ceb6631d645a4db48726d42eb0ad2da0/users/0a97dbe40e0b4260896a252c5d97f83d/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:31.923617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb6631d645a4db48726d42eb0ad2da0, user_id=0a97dbe40e0b4260896a252c5d97f83d, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:31.926957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:31.941898 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1385/2760] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:31 2021] PUT /identity/v3/projects/ceb6631d645a4db48726d42eb0ad2da0/users/0a97dbe40e0b4260896a252c5d97f83d/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:31.946123 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:31.957199 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9f04c-fedf-410f-b06f-262d5a4d0390 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:32.016090 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0cde-923e-414b-a15f-a2a50d361ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:32.016696 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0cde-923e-414b-a15f-a2a50d361ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:32.016971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0cde-923e-414b-a15f-a2a50d361ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:32.017245 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0cde-923e-414b-a15f-a2a50d361ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:32.017982 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0cde-923e-414b-a15f-a2a50d361ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:32.019784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b0cde-923e-414b-a15f-a2a50d361ab6 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:32.031871 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1376/2761] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:32.038581 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:32.054037 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab994c-cd8c-4efc-98fa-325e7efbb2d8 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:32.059138 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:32.060060 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:32.060336 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:32.060602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] PATH_INFO: `/v3/projects/ceb6631d645a4db48726d42eb0ad2da0/users/0a97dbe40e0b4260896a252c5d97f83d/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:32.062691 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb6631d645a4db48726d42eb0ad2da0, user_id=0a97dbe40e0b4260896a252c5d97f83d, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:32.065381 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:32.076092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1386/2762] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:32 2021] PUT /identity/v3/projects/ceb6631d645a4db48726d42eb0ad2da0/users/0a97dbe40e0b4260896a252c5d97f83d/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:32.086941 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:32.087232 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:32.087529 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:32.117986 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] MFA Rules not processed for user `0a97dbe40e0b4260896a252c5d97f83d`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:32.119236 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:32.187222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1377/2763] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:32 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:32.199383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:32.201424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:32.260127 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d0685-0830-4077-9635-e0cec90821d2 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:32.264534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:32.265174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:32.265453 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:32.265723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:32.275303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:32.276695 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:32.286578 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1387/2764] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:32 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:32.773831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:32.775577 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:32.789906 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf7dc8-25ae-42d7-9f82-439c8c35470d None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:32.793872 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:32.794487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:32.794764 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:32.795036 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:32.855011 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:32.856482 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:32.865222 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1378/2765] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:32 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:36.981502 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:36.990474 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1de0-196a-4786-ae12-4ddc2be12eff service cinder] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:36.994868 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f89af1-d415-43af-8e64-4318e0494432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:36.995551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f89af1-d415-43af-8e64-4318e0494432 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:36.995833 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f89af1-d415-43af-8e64-4318e0494432 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:36.996105 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f89af1-d415-43af-8e64-4318e0494432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:37.054678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f89af1-d415-43af-8e64-4318e0494432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:37.056088 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f89af1-d415-43af-8e64-4318e0494432 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:37.065299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1388/2766] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:36 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:39.222323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:39.292415 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90d0d4-8a36-400b-a7d9-d30df2651ca2 service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:39.298433 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:39.299302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:39.299615 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:39.299884 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] PATH_INFO: `/v3/users/70fdeffd60864d3da3242a4e1e5dc0fc` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:39.301522 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fdeffd60864d3da3242a4e1e5dc0fc)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:39.303488 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:39.369722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fdeffd60864d3da3242a4e1e5dc0fc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:39.376535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fdeffd60864d3da3242a4e1e5dc0fc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:39.377269 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fdeffd60864d3da3242a4e1e5dc0fc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:39.390430 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fdeffd60864d3da3242a4e1e5dc0fc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:39.391136 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fdeffd60864d3da3242a4e1e5dc0fc'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:39.407637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1379/2767] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:39 2021] DELETE /identity/v3/users/70fdeffd60864d3da3242a4e1e5dc0fc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:39.412308 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:39.412809 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:39.412924 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:39.431981 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:39.433123 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:39.505398 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1389/2768] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:39.516974 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:39.518536 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:39.591160 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b5f-e58d-4034-9ac3-961f10425eab admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:39.595379 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:39.596043 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:39.596322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:39.596595 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:39.606486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:39.608138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:39.617851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1380/2769] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:39.921364 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:39.922928 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:39.938592 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8745732-7931-4548-af11-3a8a808ec9c8 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:39.943741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:39.944703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:39.945007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:39.945345 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] PATH_INFO: `/v3/projects/fd585ad32f5240bcb045f616eb483f79` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:39.946745 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd585ad32f5240bcb045f616eb483f79)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:39.948612 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:39.998790 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd585ad32f5240bcb045f616eb483f79', 'request_id': 'req-53d62e57-9ae9-4dbc-8325-050dfd8d4062'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.004842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd585ad32f5240bcb045f616eb483f79', 'request_id': 'req-53d62e57-9ae9-4dbc-8325-050dfd8d4062'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.012912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd585ad32f5240bcb045f616eb483f79', 'request_id': 'req-53d62e57-9ae9-4dbc-8325-050dfd8d4062'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.023199 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] The token cache is being invalidate because project fd585ad32f5240bcb045f616eb483f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:40.023584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.024225 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.025767 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1390/2770] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:39 2021] DELETE /identity/v3/projects/fd585ad32f5240bcb045f616eb483f79 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:40.029985 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:40.040315 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8a6f0-8163-4a28-af2b-5ec5589fdc16 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:40.103484 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:40.104362 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:40.104647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:40.104924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] PATH_INFO: `/v3/users/97dd7df6793648cab31e5fe64526110b` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:40.106216 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dd7df6793648cab31e5fe64526110b)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:40.108214 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:40.160300 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dd7df6793648cab31e5fe64526110b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.167117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dd7df6793648cab31e5fe64526110b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.167924 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dd7df6793648cab31e5fe64526110b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.182323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dd7df6793648cab31e5fe64526110b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.183104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dd7df6793648cab31e5fe64526110b'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.199642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1381/2771] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:40 2021] DELETE /identity/v3/users/97dd7df6793648cab31e5fe64526110b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:40.523161 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:40.524851 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:40.539617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d62e57-9ae9-4dbc-8325-050dfd8d4062 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:40.609980 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:40.610802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:40.611086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:40.611386 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] PATH_INFO: `/v3/projects/4fcc4edc244745aaa79926341fa2a7a6` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:40.612617 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fcc4edc244745aaa79926341fa2a7a6)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:40.614529 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:40.664602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fcc4edc244745aaa79926341fa2a7a6', 'request_id': 'req-1eed56e5-3f08-4a8a-80ad-b82c44622b36'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.671003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fcc4edc244745aaa79926341fa2a7a6', 'request_id': 'req-1eed56e5-3f08-4a8a-80ad-b82c44622b36'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.680518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fcc4edc244745aaa79926341fa2a7a6', 'request_id': 'req-1eed56e5-3f08-4a8a-80ad-b82c44622b36'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.690900 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] The token cache is being invalidate because project 4fcc4edc244745aaa79926341fa2a7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:40.691191 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.691881 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.693584 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1391/2772] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:40 2021] DELETE /identity/v3/projects/4fcc4edc244745aaa79926341fa2a7a6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:40.698278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:40.699998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:40.718376 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d8af-8523-4549-8bc9-ee35540de181 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:40.783267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:40.784185 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:40.784468 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:40.784845 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] PATH_INFO: `/v3/users/0a97dbe40e0b4260896a252c5d97f83d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:40.786081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a97dbe40e0b4260896a252c5d97f83d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:40.788060 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:40.837971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a97dbe40e0b4260896a252c5d97f83d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.847500 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a97dbe40e0b4260896a252c5d97f83d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.848215 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a97dbe40e0b4260896a252c5d97f83d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.860729 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a97dbe40e0b4260896a252c5d97f83d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.861466 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-4f11857c-9c18-403e-9348-742b33a78912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a97dbe40e0b4260896a252c5d97f83d'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:40.876581 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1382/2773] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:40 2021] DELETE /identity/v3/users/0a97dbe40e0b4260896a252c5d97f83d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:41.177859 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.180020 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:41.194395 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed56e5-3f08-4a8a-80ad-b82c44622b36 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:41.260136 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:41.261328 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.261678 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.261999 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] PATH_INFO: `/v3/projects/ceb6631d645a4db48726d42eb0ad2da0` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.263519 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb6631d645a4db48726d42eb0ad2da0)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:41.265424 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:41.327270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb6631d645a4db48726d42eb0ad2da0', 'request_id': 'req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:41.333673 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb6631d645a4db48726d42eb0ad2da0', 'request_id': 'req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:41.344602 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb6631d645a4db48726d42eb0ad2da0', 'request_id': 'req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:41.360368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] The token cache is being invalidate because project ceb6631d645a4db48726d42eb0ad2da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:41.360676 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:41.361383 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-39fed7f8-e6bb-4e1b-8262-bae4bea2b3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:41.363040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1392/2774] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:41 2021] DELETE /identity/v3/projects/ceb6631d645a4db48726d42eb0ad2da0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:41.370671 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6f12-1f8d-4ca2-b6f1-4726d05e1772 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.371224 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6f12-1f8d-4ca2-b6f1-4726d05e1772 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.371651 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a6f12-1f8d-4ca2-b6f1-4726d05e1772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.392925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-f28a6f12-1f8d-4ca2-b6f1-4726d05e1772 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:41.394535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-f28a6f12-1f8d-4ca2-b6f1-4726d05e1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:41.460846 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1383/2775] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:41.470457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89651415-564a-42ea-b4cf-fb557b94edb5 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.470737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89651415-564a-42ea-b4cf-fb557b94edb5 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.471018 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89651415-564a-42ea-b4cf-fb557b94edb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.491059 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-89651415-564a-42ea-b4cf-fb557b94edb5 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:41.492539 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-89651415-564a-42ea-b4cf-fb557b94edb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:41.502062 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1393/2776] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:41.506523 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6f12-1f8d-4ca2-b6f1-4726d05e1772 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.517469 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a6f12-1f8d-4ca2-b6f1-4726d05e1772 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:41.524919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:41.525751 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.526150 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.526497 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.527275 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:41.527889 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:41.530049 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:41.543952 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1384/2777] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:43:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 03:43:41.548506 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89651415-564a-42ea-b4cf-fb557b94edb5 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.558469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89651415-564a-42ea-b4cf-fb557b94edb5 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:41.563634 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:41.564288 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.564568 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.564822 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.565546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:41.567466 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:41.601368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1394/2778] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:41 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:41.607446 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.620152 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5083a1-f1e3-42e1-8503-fc7f2e08462c admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:41.682912 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:41.683611 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.683897 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.684174 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.684860 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:41.686869 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:41.712576 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1385/2779] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:41 2021] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:41.716889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.730990 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932202e-6825-417d-bfc0-8e7c67c3b76d admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:41.739490 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:41.740449 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.740727 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.741001 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.741853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:41.743741 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:41.756262 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1395/2780] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:41 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:41.761762 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.773852 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd6201-693b-4990-ad75-4e88195f6fb2 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:41.779618 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27714ec3-08e7-4397-bb84-44d97d338a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:41.780285 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714ec3-08e7-4397-bb84-44d97d338a12 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.780559 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714ec3-08e7-4397-bb84-44d97d338a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.780824 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27714ec3-08e7-4397-bb84-44d97d338a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.781550 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27714ec3-08e7-4397-bb84-44d97d338a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:41.783167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27714ec3-08e7-4397-bb84-44d97d338a12 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:41.797579 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1386/2781] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:41.804329 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.816377 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab68b3-0bf4-420b-8c52-4d4b3cf4c824 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:41.821388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:41.822303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.822586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.822866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] PATH_INFO: `/v3/projects/064e786371f8446db4942877352a89da/users/26db55d99dc2450f904b94d94b3f2b8c/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.841354 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=064e786371f8446db4942877352a89da, user_id=26db55d99dc2450f904b94d94b3f2b8c, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:41.844084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:41.859009 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1396/2782] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:41 2021] PUT /identity/v3/projects/064e786371f8446db4942877352a89da/users/26db55d99dc2450f904b94d94b3f2b8c/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:41.870837 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5a27-3ddc-4a6a-8bc2-95afbbbecc66 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:41.871138 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5a27-3ddc-4a6a-8bc2-95afbbbecc66 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:41.871487 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5a27-3ddc-4a6a-8bc2-95afbbbecc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:41.899718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-4aed5a27-3ddc-4a6a-8bc2-95afbbbecc66 None None] MFA Rules not processed for user `26db55d99dc2450f904b94d94b3f2b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:41.900935 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4aed5a27-3ddc-4a6a-8bc2-95afbbbecc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:41.971838 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1387/2783] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:41.984284 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:41.986703 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:42.070220 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80676f-5deb-4a3a-a07b-7269c112b20e admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:42.075369 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a564a-2e1a-478e-8cd7-6cf09f8fa5a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:42.076023 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a564a-2e1a-478e-8cd7-6cf09f8fa5a5 service cinder] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:42.076304 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a564a-2e1a-478e-8cd7-6cf09f8fa5a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:42.076573 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a564a-2e1a-478e-8cd7-6cf09f8fa5a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:42.085914 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a564a-2e1a-478e-8cd7-6cf09f8fa5a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:42.087372 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a564a-2e1a-478e-8cd7-6cf09f8fa5a5 service cinder] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:42.096423 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1397/2784] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:41 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:52.291092 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed5a27-3ddc-4a6a-8bc2-95afbbbecc66 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:52.360953 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed5a27-3ddc-4a6a-8bc2-95afbbbecc66 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:52.366194 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:52.367227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:52.367531 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:52.367805 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] PATH_INFO: `/v3/users/26db55d99dc2450f904b94d94b3f2b8c` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:52.369106 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26db55d99dc2450f904b94d94b3f2b8c)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:52.371033 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:52.425676 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26db55d99dc2450f904b94d94b3f2b8c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:52.433545 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26db55d99dc2450f904b94d94b3f2b8c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:52.434322 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26db55d99dc2450f904b94d94b3f2b8c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:52.448267 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26db55d99dc2450f904b94d94b3f2b8c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:52.448971 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26db55d99dc2450f904b94d94b3f2b8c'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:52.466265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1388/2785] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:43:52 2021] DELETE /identity/v3/users/26db55d99dc2450f904b94d94b3f2b8c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:52.471026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:52.471579 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:52.471693 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:52.488955 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:52.490194 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:52.549291 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1398/2786] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:52.564610 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:52.566939 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:52.628683 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff3dc-0c57-4562-974d-efc4080858f1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:52.633647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be722db-bcc6-4165-b4f8-36947c2e696c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:52.634291 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be722db-bcc6-4165-b4f8-36947c2e696c service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:52.634571 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be722db-bcc6-4165-b4f8-36947c2e696c service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:52.634841 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be722db-bcc6-4165-b4f8-36947c2e696c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:52.644192 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be722db-bcc6-4165-b4f8-36947c2e696c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:52.645642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be722db-bcc6-4165-b4f8-36947c2e696c service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:52.655115 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1389/2787] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:52.940510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:52.943122 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:52.955172 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c0fb6-36bb-417d-b7c3-55bef2367b77 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:52.960207 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:52.961092 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:52.961419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:52.961842 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] PATH_INFO: `/v3/projects/064e786371f8446db4942877352a89da` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:52.963048 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064e786371f8446db4942877352a89da)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:52.965053 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.014045 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064e786371f8446db4942877352a89da', 'request_id': 'req-5084d0cc-cd64-446f-b546-58232d6b6609'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:53.019957 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064e786371f8446db4942877352a89da', 'request_id': 'req-5084d0cc-cd64-446f-b546-58232d6b6609'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:53.029040 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064e786371f8446db4942877352a89da', 'request_id': 'req-5084d0cc-cd64-446f-b546-58232d6b6609'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:53.039427 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] The token cache is being invalidate because project 064e786371f8446db4942877352a89da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:43:53.039802 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:53.040428 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-5084d0cc-cd64-446f-b546-58232d6b6609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:43:53.042086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1399/2788] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:43:52 2021] DELETE /identity/v3/projects/064e786371f8446db4942877352a89da => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:53.051021 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b7ae-7d8a-4fd6-85dd-6d9a649e8c8f None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.051308 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b7ae-7d8a-4fd6-85dd-6d9a649e8c8f None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.051619 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246b7ae-7d8a-4fd6-85dd-6d9a649e8c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.071024 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-4246b7ae-7d8a-4fd6-85dd-6d9a649e8c8f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:53.072326 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-4246b7ae-7d8a-4fd6-85dd-6d9a649e8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:53.138911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1390/2789] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 03:43:53.149450 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09f4b-f5b8-45e8-badf-0018c1fcd99f None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.149867 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09f4b-f5b8-45e8-badf-0018c1fcd99f None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.150286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09f4b-f5b8-45e8-badf-0018c1fcd99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.181246 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-dcd09f4b-f5b8-45e8-badf-0018c1fcd99f None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:53.182460 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-dcd09f4b-f5b8-45e8-badf-0018c1fcd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:53.191443 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1400/2790] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:53.196994 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b7ae-7d8a-4fd6-85dd-6d9a649e8c8f None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:53.208102 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246b7ae-7d8a-4fd6-85dd-6d9a649e8c8f None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:53.214575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:53.215257 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.215575 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.215847 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.216563 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 03:43:53.216866 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:53.218474 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.232680 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1391/2791] 10.222.0.58 () {58 vars in 1153 bytes} [Fri Aug 27 03:43:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 03:43:53.238770 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09f4b-f5b8-45e8-badf-0018c1fcd99f None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:53.253109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09f4b-f5b8-45e8-badf-0018c1fcd99f None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:53.259627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:53.260371 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.260644 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.260932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.261641 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:53.263627 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.294409 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1401/2792] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:53 2021] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:53.298684 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:53.310542 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26895ec-8ea5-4c62-be6d-a71e28d43d9e admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:53.372264 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:53.372966 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.373244 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.373512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.374221 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:53.376202 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.399605 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1392/2793] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:53 2021] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:53.404012 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:53.416309 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091f0f0-242c-4a30-a2ee-f031b2979c57 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:53.421631 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:53.422299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.422576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.422846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.423626 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:53.425551 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.437201 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1402/2794] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:53.443670 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:53.454486 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824ba1-56a6-432d-a924-0bd1f9b3a444 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:53.460420 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4c67f-e938-41da-ab3f-338174331ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:53.461161 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4c67f-e938-41da-ab3f-338174331ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.461449 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4c67f-e938-41da-ab3f-338174331ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.461747 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4c67f-e938-41da-ab3f-338174331ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.462511 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4c67f-e938-41da-ab3f-338174331ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:53.464169 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4c67f-e938-41da-ab3f-338174331ba8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.474667 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1393/2795] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:53.478707 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:53.488926 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77421630-b38b-4f42-9c2a-0ddce8b84975 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:53.494167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:53.495084 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.495391 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.495668 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] PATH_INFO: `/v3/projects/3b3caaf70e4a491c8eafa684e6f8930e/users/a051500af0e74e6381541d68ac0db85e/roles/55c10f17e7054dcc8c972f27c8c835ec` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.510563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3caaf70e4a491c8eafa684e6f8930e, user_id=a051500af0e74e6381541d68ac0db85e, role_id=55c10f17e7054dcc8c972f27c8c835ec)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:53.513252 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.529640 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1403/2796] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:53 2021] PUT /identity/v3/projects/3b3caaf70e4a491c8eafa684e6f8930e/users/a051500af0e74e6381541d68ac0db85e/roles/55c10f17e7054dcc8c972f27c8c835ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:53.584298 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740115-baea-488e-b88e-dcc0b3ff3870 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.584639 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740115-baea-488e-b88e-dcc0b3ff3870 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.585187 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c740115-baea-488e-b88e-dcc0b3ff3870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.606261 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-1c740115-baea-488e-b88e-dcc0b3ff3870 None None] MFA Rules not processed for user `7fef28dc8c914392b02ef34cf0bcbb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:53.607517 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1c740115-baea-488e-b88e-dcc0b3ff3870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:53.686081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1394/2797] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:53.697855 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:53.699836 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:53.762026 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21202d94-784f-4127-877d-a08033cb5a6a admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:53.766706 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:53.767435 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:53.767737 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:53.768011 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:53.778254 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:53.779752 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:53.789753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1404/2798] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:43:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:43:57.743196 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd72a-6920-4aaf-89df-9bcee0dc6c1a None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:57.743840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd72a-6920-4aaf-89df-9bcee0dc6c1a None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:57.743840 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dd72a-6920-4aaf-89df-9bcee0dc6c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:57.774104 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-910dd72a-6920-4aaf-89df-9bcee0dc6c1a None None] MFA Rules not processed for user `a051500af0e74e6381541d68ac0db85e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:43:57.775271 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-910dd72a-6920-4aaf-89df-9bcee0dc6c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:43:57.840968 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1395/2799] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:43:57 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:43:57.845738 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:57.855797 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4dae3-5223-4704-a944-63a83861c714 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:57.860799 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:57.861523 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:57.861765 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:57.862198 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:57.862897 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:57.864888 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:57.908818 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1405/2800] 10.222.0.58 () {60 vars in 1153 bytes} [Fri Aug 27 03:43:57 2021] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 03:43:57.913159 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd72a-6920-4aaf-89df-9bcee0dc6c1a None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:57.924179 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dd72a-6920-4aaf-89df-9bcee0dc6c1a None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:57.987004 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:57.987758 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:57.988066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:57.988382 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] PATH_INFO: `/v3/users` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:57.989117 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:57.991278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.016647 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1396/2801] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Aug 27 03:43:57 2021] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 03:43:58.017966 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.029351 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669e05a-75b8-4d49-b209-1de935641ad3 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.034174 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.034909 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.035208 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.035508 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.036243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.037947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.049605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1406/2802] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:58.054130 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.064700 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3a2e-b7c2-4c3a-810b-ece5d8fc9818 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.070058 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.071081 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.071465 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.071806 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] PATH_INFO: `/v3/projects/1d19c9c75d844783b312ae6293bfbe81/users/59813a7f129f4eabbfa51dd80227d0a9/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.088164 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d19c9c75d844783b312ae6293bfbe81, user_id=59813a7f129f4eabbfa51dd80227d0a9, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.091080 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.105558 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1397/2803] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:58 2021] PUT /identity/v3/projects/1d19c9c75d844783b312ae6293bfbe81/users/59813a7f129f4eabbfa51dd80227d0a9/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:43:58.109705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.121222 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc92c2-83cb-4084-ab2b-e2e5c50c1a67 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.182889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169206-9cd7-4dba-ba60-c76d323eea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.183650 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169206-9cd7-4dba-ba60-c76d323eea30 admin admin] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.183912 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169206-9cd7-4dba-ba60-c76d323eea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.184181 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169206-9cd7-4dba-ba60-c76d323eea30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.184937 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169206-9cd7-4dba-ba60-c76d323eea30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.186844 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169206-9cd7-4dba-ba60-c76d323eea30 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.197774 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1407/2804] 10.222.0.58 () {58 vars in 1122 bytes} [Fri Aug 27 03:43:58 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 03:43:58.202243 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:43:58.214734 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356f034-5dde-433a-b080-d9f55e765ca1 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:43:58.219655 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:43:58.220589 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:43:58.220874 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:43:58.221327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] PATH_INFO: `/v3/projects/1d19c9c75d844783b312ae6293bfbe81/users/59813a7f129f4eabbfa51dd80227d0a9/roles/723f92c5421e4848a33b9ec1aa718b2d` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:43:58.223779 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d19c9c75d844783b312ae6293bfbe81, user_id=59813a7f129f4eabbfa51dd80227d0a9, role_id=723f92c5421e4848a33b9ec1aa718b2d)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:43:58.226792 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:43:58.238299 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1398/2805] 10.222.0.58 () {60 vars in 1483 bytes} [Fri Aug 27 03:43:58 2021] PUT /identity/v3/projects/1d19c9c75d844783b312ae6293bfbe81/users/59813a7f129f4eabbfa51dd80227d0a9/roles/723f92c5421e4848a33b9ec1aa718b2d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:44:02.744952 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d6ff-606d-475b-ad63-fa517cc5939b None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:02.745483 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d6ff-606d-475b-ad63-fa517cc5939b None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:02.745575 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d6ff-606d-475b-ad63-fa517cc5939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:02.789154 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-6781d6ff-606d-475b-ad63-fa517cc5939b None None] MFA Rules not processed for user `59813a7f129f4eabbfa51dd80227d0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:02.790346 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6781d6ff-606d-475b-ad63-fa517cc5939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:02.867112 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1408/2806] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:44:02 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:02.876452 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:02.878649 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:03.005936 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e1ee2-6030-44f0-bef0-12972e4925d8 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:03.016925 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:03.018050 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:03.018557 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:03.019329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:03.094158 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:03.096086 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:03.106054 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1399/2807] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:02 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:20.793270 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] REQUEST_METHOD: `POST` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.793864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.793864 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.814479 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.auth.core [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] MFA Rules not processed for user `a051500af0e74e6381541d68ac0db85e`. Rule list: `[]` (Enabled: `True`). {{(pid=73390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:44:20.815754 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:20.824187 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1409/2808] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:44:20 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:44:20.862478 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:20.865053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:20.946593 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562535a3-0894-4210-bf51-7c9a2b327802 service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:20.954278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d8aa6c0fa94ced8f7b277572b06dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:20.955228 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:20.955718 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:20.956074 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:20.959030 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:20.975413 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:20.976972 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:20.990851 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1400/2809] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:21.294498 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.296086 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.371920 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a5550-18b1-40bc-9a57-f20e4b278740 None None] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.376614 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.377299 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.377576 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.377846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.380146 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.390501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.391978 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.400782 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1410/2810] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:21.885821 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.887292 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.905712 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:21.914684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ee2ff-8d3c-4a86-8e72-0f80310e8e1d service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.919029 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.919720 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.919998 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.920266 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.922286 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.936419 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.937853 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.949228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1411/2811] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:21.960329 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450eaad-a004-4e42-9950-f90bf62be6fb service cinder] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:21.965777 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:21.966443 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:21.966722 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:21.966998 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:21.968950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:21.981480 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:21.983110 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:21.993848 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1401/2812] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:21 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:23.718469 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:23.728230 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a8e22-9d50-494c-8da1-bb2cb1f7749b service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:23.732457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:23.733148 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:23.733429 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:23.733701 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:23.735932 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:23.748238 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:23.749930 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:23.760725 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1412/2813] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:23 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:24.486048 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:24.487746 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:24.504445 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a5bd3-c990-4436-8fc3-570afff3c34c service placement] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:24.511053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:24.511990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:24.512265 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:24.512710 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:24.514544 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:24.529944 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:24.532020 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:24.544692 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1402/2814] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:24 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:34.070028 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:34.084043 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c0509-24d8-48ed-a0a6-53d462ded0c6 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:34.089889 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:34.090546 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:34.090828 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:34.091109 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:34.092996 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:34.107516 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:34.109228 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:34.120457 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1413/2815] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:36.369380 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:36.380167 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc995c58-fcdb-473f-a400-1e9e48731d9b service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:36.385286 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760dd24-3b75-4fd1-92cf-822f88214789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:36.385969 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760dd24-3b75-4fd1-92cf-822f88214789 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:36.386227 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760dd24-3b75-4fd1-92cf-822f88214789 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:36.386498 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760dd24-3b75-4fd1-92cf-822f88214789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:36.397920 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760dd24-3b75-4fd1-92cf-822f88214789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:36.399495 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760dd24-3b75-4fd1-92cf-822f88214789 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:36.409374 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1403/2816] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:36 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:44:38.162370 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:44:38.175600 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a60f79-208f-459b-b205-a07b1445d6f5 service nova] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:44:38.182340 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:44:38.183103 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:44:38.183510 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:44:38.183692 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:44:38.185531 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:44:38.198534 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:44:38.200169 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:44:38.210843 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1414/2817] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:44:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:46:39.005241 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8850e5-4e5c-48aa-92ba-5b721b2f6921 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:46:39.005801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8850e5-4e5c-48aa-92ba-5b721b2f6921 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:46:39.005801 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8850e5-4e5c-48aa-92ba-5b721b2f6921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:46:39.026066 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0b8850e5-4e5c-48aa-92ba-5b721b2f6921 None None] MFA Rules not processed for user `a051500af0e74e6381541d68ac0db85e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:46:39.027289 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0b8850e5-4e5c-48aa-92ba-5b721b2f6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:46:39.035768 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1404/2818] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:46:39 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:47:38.726357 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:47:38.728107 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:38.743894 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416dc3f-8edc-405b-813e-e0124a3f5105 service nova] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:47:38.750303 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:47:38.750947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:47:38.751231 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:47:38.751536 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:47:38.753658 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:47:38.765845 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:47:38.767481 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:47:38.782080 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1415/2819] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:47:38 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:48:35.347391 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae755cd-e2ac-4306-a11a-9b9f2c49d088 None None] REQUEST_METHOD: `POST` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:48:35.347967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae755cd-e2ac-4306-a11a-9b9f2c49d088 None None] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:48:35.347967 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae755cd-e2ac-4306-a11a-9b9f2c49d088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:48:35.366699 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.auth.core [None req-0ae755cd-e2ac-4306-a11a-9b9f2c49d088 None None] MFA Rules not processed for user `a051500af0e74e6381541d68ac0db85e`. Rule list: `[]` (Enabled: `True`). {{(pid=73389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 03:48:35.367956 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-0ae755cd-e2ac-4306-a11a-9b9f2c49d088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:48:35.375759 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1405/2820] 10.222.0.58 () {58 vars in 958 bytes} [Fri Aug 27 03:48:35 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 03:49:39.433405 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:49:39.444320 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a067e99-1d29-4012-98a1-050fff9017dc service placement] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:49:39.448866 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:49:39.449527 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:49:39.449801 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:49:39.450064 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:49:39.458010 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:49:39.459501 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:49:39.467733 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1416/2821] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:49:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:50:25.750240 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae755cd-e2ac-4306-a11a-9b9f2c49d088 None None] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:25.761736 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae755cd-e2ac-4306-a11a-9b9f2c49d088 None None] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:25.766254 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:25.766919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:25.767201 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:25.767512 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:25.780807 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:25.782278 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:25.792426 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1406/2822] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:50:25 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:50:26.736446 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:26.751190 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7af47-281c-43e9-bb22-b22939f50813 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:26.756783 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:26.757438 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:26.757723 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:26.758003 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:26.768586 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:26.770167 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:26.781753 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1417/2823] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:50:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:50:26.914740 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:26.925094 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2b0e-a6aa-4ae8-9752-61b9c05eb363 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:26.928950 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:26.929637 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:26.929919 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:26.930189 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:26.941458 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:26.943302 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:26.955203 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1407/2824] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:50:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:50:28.216467 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:28.225942 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef7c8-a142-4cf0-8018-85ca6a235f2d service nova] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:28.230361 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:28.231085 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:28.231330 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:28.231611 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:28.243794 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:28.245209 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:28.256314 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1418/2825] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:50:28 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:50:33.727573 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:33.739399 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e00025-3973-4c6f-b0f4-515411352c57 service neutron] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:33.745940 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068da11e10ca4a788bb08a42206ca42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:33.746760 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:33.747051 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:33.747325 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:33.758190 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:33.759885 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:33.773305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1408/2826] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:50:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 03:50:39.363849 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:39.373152 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd010-9195-4aeb-80d1-74242398f571 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:39.377837 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3357ca71ec4443f8a9fba9b7ac4cfdd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:39.378605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] REQUEST_METHOD: `GET` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:39.378884 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:39.379147 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:39.442542 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:39.444034 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:39.454846 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1419/2827] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:50:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 03:50:46.048406 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:46.059409 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87dd39-5f55-4713-974e-d69de85a2f8f service nova] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:46.067726 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:46.069044 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:46.069477 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:46.069767 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] PATH_INFO: `/v3/users/a051500af0e74e6381541d68ac0db85e` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:46.071831 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a051500af0e74e6381541d68ac0db85e)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:46.074916 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:46.124327 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a051500af0e74e6381541d68ac0db85e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.132205 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a051500af0e74e6381541d68ac0db85e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.132981 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a051500af0e74e6381541d68ac0db85e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.145911 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a051500af0e74e6381541d68ac0db85e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.146634 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a051500af0e74e6381541d68ac0db85e'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.161305 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1409/2828] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:50:46 2021] DELETE /identity/v3/users/a051500af0e74e6381541d68ac0db85e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 03:50:46.594229 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:46.604705 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f041-4132-4612-8641-3709da82a787 service neutron] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:46.664019 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:46.664918 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:46.665193 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:46.665464 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] PATH_INFO: `/v3/projects/3b3caaf70e4a491c8eafa684e6f8930e` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:46.666684 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3caaf70e4a491c8eafa684e6f8930e)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:46.668643 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:46.717567 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3caaf70e4a491c8eafa684e6f8930e', 'request_id': 'req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.725537 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3caaf70e4a491c8eafa684e6f8930e', 'request_id': 'req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.734513 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3caaf70e4a491c8eafa684e6f8930e', 'request_id': 'req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.746368 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] The token cache is being invalidate because project 3b3caaf70e4a491c8eafa684e6f8930e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:50:46.746662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.747388 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.748993 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1420/2829] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:50:46 2021] DELETE /identity/v3/projects/3b3caaf70e4a491c8eafa684e6f8930e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:50:46.753323 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:46.754888 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:50:46.769387 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344e5e-d672-4885-82b4-8503c7268e12 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:46.837881 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:46.838743 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:46.839014 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:46.839283 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] PATH_INFO: `/v3/users/59813a7f129f4eabbfa51dd80227d0a9` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:46.840600 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59813a7f129f4eabbfa51dd80227d0a9)` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:46.842587 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:46.897854 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59813a7f129f4eabbfa51dd80227d0a9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.904719 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59813a7f129f4eabbfa51dd80227d0a9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.905410 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59813a7f129f4eabbfa51dd80227d0a9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.917608 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59813a7f129f4eabbfa51dd80227d0a9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.918246 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.notifications [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59813a7f129f4eabbfa51dd80227d0a9'} {{(pid=73389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:46.933719 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1410/2830] 10.222.0.58 () {58 vars in 1224 bytes} [Fri Aug 27 03:50:46 2021] DELETE /identity/v3/users/59813a7f129f4eabbfa51dd80227d0a9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:50:47.120090 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Authenticating user token {{(pid=73390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:50:47.121563 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.fernet_utils [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:50:47.135804 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0a2fd-58a2-4e80-805e-32fc9d7e3409 admin admin] Validating token access rules against request {{(pid=73390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:50:47.197749 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fef28dc8c914392b02ef34cf0bcbb9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd18f6074b9647bca69baffc389eb123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:50:47.198947 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:50:47.199210 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:50:47.199518 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] PATH_INFO: `/v3/projects/1d19c9c75d844783b312ae6293bfbe81` {{(pid=73390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:50:47.200718 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d19c9c75d844783b312ae6293bfbe81)` {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:50:47.202662 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] RBAC: Authorization granted {{(pid=73390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:50:47.253072 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d19c9c75d844783b312ae6293bfbe81', 'request_id': 'req-e541f234-c648-44d6-9bc9-266d72981a29'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:47.259007 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d19c9c75d844783b312ae6293bfbe81', 'request_id': 'req-e541f234-c648-44d6-9bc9-266d72981a29'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:47.267743 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d19c9c75d844783b312ae6293bfbe81', 'request_id': 'req-e541f234-c648-44d6-9bc9-266d72981a29'} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:47.278323 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] The token cache is being invalidate because project 1d19c9c75d844783b312ae6293bfbe81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 03:50:47.278605 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:47.279243 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: DEBUG keystone.notifications [None req-e541f234-c648-44d6-9bc9-266d72981a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 03:50:47.280791 dv-cinder-804735-2-iscsi devstack@keystone.service[73390]: [pid: 73390|app: 0|req: 1421/2831] 10.222.0.58 () {58 vars in 1233 bytes} [Fri Aug 27 03:50:47 2021] DELETE /identity/v3/projects/1d19c9c75d844783b312ae6293bfbe81 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 03:52:42.705990 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Authenticating user token {{(pid=73389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 03:52:42.707784 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:52:42.861535 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b658d0-25f6-430b-8ca8-0dd27a0fc9e7 admin admin] Validating token access rules against request {{(pid=73389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 03:52:42.926398 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e110d23-8d53-465e-b43d-6dfcbc315c73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58838486fa5f49c4bca67ad01713fefd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7671c5ef4cc4e349a81068be7439863', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 03:52:42.927053 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e110d23-8d53-465e-b43d-6dfcbc315c73 service placement] REQUEST_METHOD: `GET` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 03:52:42.927333 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e110d23-8d53-465e-b43d-6dfcbc315c73 service placement] SCRIPT_NAME: `/identity` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 03:52:42.927642 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e110d23-8d53-465e-b43d-6dfcbc315c73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 03:52:42.929656 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.fernet_utils [None req-1e110d23-8d53-465e-b43d-6dfcbc315c73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 03:52:42.941006 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e110d23-8d53-465e-b43d-6dfcbc315c73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 03:52:42.942602 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e110d23-8d53-465e-b43d-6dfcbc315c73 service placement] RBAC: Authorization granted {{(pid=73389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 03:52:42.952731 dv-cinder-804735-2-iscsi devstack@keystone.service[73389]: [pid: 73389|app: 0|req: 1411/2832] 10.222.0.58 () {60 vars in 1366 bytes} [Fri Aug 27 03:52:42 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)